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ABSTRACT 

The Task 2 report, representing part of an 
investigation coordinated by a committee working under the aufefc>ices 
of the National Council for the Social Studies, provides an analysis 
of the responses to a selected set of U8 exercises within the NAEP 
for Social Studies* One section of the exercises deals with the 
knowledge of structural elements of government institutions, while 
the second set deals with the knowledge of rights and duties within 
these institutions* The analysis involves the breakdown of data by 
ages 9, 13, 17, and adult; northeast, southeast, central, and west 
regions of the 0*S*; two sexes; white and black races; four levels of 
parents' education; and seven size and type of community categories* 
The results indicate the lowest level of knowledge at age 9 and the 
highest level of knowledge at age 17, and show that those persons in 
all age levels whose parents went to college, persons who live in 
relative affluence, persons who live in the northeast part of the 
country, males at age 17 and as adnlts, and whites at all ages are 
most able in all categories of assessment* Conversely, those persons 
whose parents never went beyond the eighth grade, persons who live in 
the inner city, persons who live in the southeast part of the 
country, females, and blacks do not score as well on the exercises as 
do persons in most other categories* One drawback of the assessment 
is that it provides only descriptive data and does not account for 
the differences in the results* Tentative analysis and hypotheses for 
the differences are presented by the author* (DE) 
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I Introduction 



One of the major tasks identified for the overall asse-ssnent of 
National Assessment, Social Studies, by a researcher group from the 
National Council for the Social Studies was an interpretation of the 
data generated in the Citizenship Assessment of 1969-1970 and the Social 
StMies Assessment of 1971-1972. The expectation was that ways could 
be found to compare the findings from the two assessments since they 
Shared areas of interest. Perhaps a confirmation of citizenship find- 
ings or even some indication of growth between the two assessments 
would somehow fall out of the comparisons. 

It was further expected that a number of different groupings of 
the data would allow some useful embellishments in our interpretations. 
In general, these groupings require the selection of items from the 
total assessment to be treated together. Tne going idioms at NAfiP for 
such a group of items are "color scheme" and "theme." The computer is 
asked to put the items together in order to compute all manner of sta- 
tistical results which presumably say more to the researcher about the 
population he is working with than if he had resUts only from indivi- 
dual items. The options in the NAEP model are individual item data and 
data from clusters of items or "color schemes," 

The intention in the NCSS assessment was to use a propitious com- 
bination of these two options. A variety of "color schemes" was envi- 
sioned, e.g., factual items, value items, skill items, historical items, 
sociology items, economics items, etc., items grouped according to the 
NCSS guidelinesi items grouped by NAEP objectives in social studies? 



iten.8 grouped by a variety of content themes other than the mother 
disciplines, e.g., racial concerns, moral questions, civil rights, 
etc. , and Items assessing critical thinking, logic, judgment and 
decision making, reasoning, etc. 

There »as also the intention of casting explanatory hypotheses 
in an effort to account for good and bad performances. There was no 
expectation that such hypotheses could be tested, of course, since 
mst data are purely descriptive. This Intention would be greatly 
enhanced by the data breakdown built Into the MET treatment. The 
treatment Involves the breakdown of data by ages 9, 13, 17, and Adult, 
Northeast, Southeast, Central, and West regions of the U.S., two sexes, 
two races, four levels of Parents- Education, and seven Size and Type 
of CcoBunlty categories. Thus, the seeker of explanations Is guided to 
ask, "Why do Blacks perform worse than Whites on this Item about the 
Supreme Court?" When a cluster of Items In a color scheme I, under con- 
slderatlon, he may ask, "Why do persons In the upper socio-economic 
areas of the cities know more about their democratic rights and duties 
than persons who live In rural areas?" 

A further Intention within this interpretive task was to draw im- 
plications for public policy. For example, one is tempted to infer frcm 
the consistently poor performances of Blacks in this assessment that 
something is awry in the conduct of schools, in curriculums, in teaching 
strategies. In the society, l„ the assessment procedures, 1„ the assess- 
ment content, or possibly In the Black population Itself. Some of these, 
at leasf , would be subject to alteration by changes In public policy. 
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A final intention was to translate findings and data Into forms 
more useful to an assortment of users. While the Naep treatment of 
data Is not at the sophisticated statistical level of much of educa- 
tional research. It Is several cuts above sijnple addition and subtra- 
ction. Multlvarlat analysis, regression formulas, correlation coeffi- 
cients, and chl squares are absent here? but there are sufficient NAEP 
Idioms, such a Raw P, Delta P, cut-off, hinge, and eighth as well as 
standard terms in the nomenclature, such as category, variable, stan- 
dard error, median, and mean, to boggle the mind. The craft of the 
Interpreter, one would suppose. Is to say obtuse things In ways that 
are meaningful to readers. 

Some Limitations - Fortuitous and Otherwise 

We have suggested some of the limitations of this interpretation. 
Chief among these is the impossibility of finding correlations between 
a performance In one situation and a performance elsewhere. Educators 
are fond of discovering such relationships, e.g., between I.Q. and 
reading or belief In x and belief In y. The reason for this limitation 
is the sampling and testing schemes employed by NAEP. As more elabor- 
ately explained in larkins* report, NAEP has constructed sample popula- 
tions of some 27,000 persons in each age group of 9, 13, and 17, and 
9,000 Adults. However, out of deference for the physical and mental 
comfort of these persons, the total number of items being used to assess 
a subject area Is divided into 10 to U sets or packages so that each 
package contains only 1/10 or 1/14 of the items. An Individual or group 
selected for testing as a part of an age sample would receive only one 
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package conuaiuing, say, 20 items out of a total of 200 to 300 in a 
subject area. Thus, the items contained in a given package would be 
answered by only 2,000 to 2,500 persons or so. Correlations between 
items within packages would be possible since these items would have 
been answered by the same persons. While NAEP has experimented with 
this further treatment of assessment data, the data presented here 
are not dealt with in th?,s way. Correlations between items in diff- 
erent packages are not statistically permissable, however, because the 
two sets of items would hive been answered by two different groups of 
people. 

Statisticians substantiate that when appropriate sampling methods 
are used, clusters of items, as in a color scheme, may be treated as 
if they represent the performance of a total age group population. Thus, 
answer., to a cluster of 10 items, while possibly the actual performances 
of 10 groups of 2,500 persons, each group having answered one item in 
the cluster, may legitimately represent the performance of the entire 
sample. An assumption of sub-group equivalency is made in this regard, 
of course. 

A second serious li«ltation relates to a series of fortuitous events 
that range temporally over a year and a half, geographically froB Washing- 
ton, D,C„ to San Francisco, and ethically from principal to expediency. 
The upshot of the difficulties Is that severed budgets. deUyed co»p„ters. 
and contract deadlines have restricted this Interpretation to fever than 
50 Items out of some 200 in the Social Studies Assessment and to two 
color schsMs out of a planned half dozen or so. Me anticipate that in 
the future this interpretation will be completed with all social studies 
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items included and with whoever additional color schemes are in the 
NA£P computer tape* 

We hope to correct another limitation in that future expansion of 
this interpretation* This document contains only limited references to 
the earlier findirss in the Citizenship Assessment* An unfortunate 
deterrent to any comparison of the results of the two assessments is 
the fixing of summary data, i*e., the color schemes or clusters, by 
different rubrics* a presumption is made, however, that some goals in 
the two areas are so similar that comparisons are possible and that 
some items in the two assessments can be found that appear to ask simiUr 
things* 

Items included* This interpretation is limited to the considera- 
tion of the items displayed as Appendix B where they are grouped into two 
color schemes* The two schemes, originally requested for this NCSS assess- 
ment in the categories of "Knowledge of Rights and Duties" and "Knowledge 
of Institutional Structures," largely parallel the social studies items 

^" Political KnotfiAH^^A .nH A,...4*..,^^^ 1971-1972, NAEP's recent pub- 
lication by Marriner and Crane* 

Reporting the Mhta 

All data, all statistical treatments of data, and all interpretatioiis 
of statistics contain inherent distortions and inaccuracies. The fact is 
that statistics, statistitions, and interpreters of statistics impose 
their own peculiar frames on data. The danger occurs in the pretense of 
purity which is not and cannot be. That pretense is not made about the 
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data and Interpretations reported here. 

For the nost part, percentage o f success is the basic statistic 
used in the NAEP assessment. That means simply the percentage of persons 
from a designated population who marked the item correctly or success- 
fully, as judged by NAEP. This statistic is called RjaJ: in NAEP jargon 
we use Raw P, percentage, and percentage of success as equivalent terms. 

Another NAEP convention derived from two percentages of success is 
also used in this report. One of these values is the National percentage 
of success on a given exercise. This value always refers to the perform- 
ance of all the persons in an age group, i.e., 9, 13, 17, or Adult, who 
responded to an exercise, usually about 2,500 persons, give or take 200- 
250. There is never a combination of ages in this or any autistic in 
reporting NAEP data. The other percentage of success used refers to 
the performance of a sub group within the exercise population, e.g.. 
Males, Femalesi Blacks, Vlhitesf persons living within the Northeast, 
Southeast, Central, or West region. The difference between the National 
percentage of success (Raw P) and the sub group's percentage of success 
(Raw P) is reported as De lta P. 

The values referred to thus far are illustrated in the following 
display. The data are presented as representing the performance of 13- 
year-olds on exercise number A06011. 

/A^A,, Sample Exercise Data Display 

A06011 13-year-old respondents ^ 
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National 


Region 


• 


Sex 




Southeast 


West Central 


Northeast 


Male Female 


Raw P 


73.72 69,9% 


74.2s: 74. U 


76. 3 


74. 4Z 73.02 


Delta P 


— -3.8 


0.5 0.4 


2.6 


0.7 -0.7 


N«*Count 


2687 706 


660 674 


647 


1381 1306 



Thus, 73.72 of the 2,687 13-year-ol<i respondents who marked this exer- 
cise, answered It correcuXy. Of the 706 IS-^ear-old respondents who 
lived In the Southeast region, 69.9^1 answered the exercise correctly. 
The Southeastern la-year-olds* percentage of success is 3.8 percentage 
points below the National percentage of success} and so on. Delta P 
values will be used In several displays in this report when referring 
to Individual exercises. 

Another statistical arrangement Is used when dealing with sunsary 
data. I.e., groups of exercises or color schenes. In this case, all the 
exercises In the color schene are ordered from highest to lowest Delta 
P values of a sub-group within an age group. The median value in this 
list of Delta Ps is taken as the typical performance of the group on 
that set of exercises. Thus, exercises in the list whose Delta P values 
are at or near this median value are said to be typical of this group's 
performance In the domain of the color scheme. A complex sutistical 
operation Is employed to determine, on the basis of such Information as 
the standard error and the difficulty of each exercise for the group, 
which of the exercises in the color scheme werft answered atypically by 
the group. Another set of statistical functions is performed to deter- 
mine whether a given Delta P value Is Urge enough to be called slgnlfl- 
cantly or reliably different than the National Raw P. Thus, when dealing 
with color schemes, the computer program gives to the Interpreter a list 
of exercises ordered by the Delta P values for which a median has been 
determined and in which performances atypical of the "group effect" have 
been demarcated and performances statistically significantly different 



than the National percentages have been flagged. These elements are 
boons to the interpreter since they give hi« something extra to say 
about the group's performance on the set of exercises, i.e., that it 
performed comparatively better or worse than expected (atypically) on 
the demarcated exercises relative to its performances on the other 
exercises and that it performed significantly better or worse than the 
whole age sample on the flagged exercises. Our use of the typical and 
significant nomenclature will remain consistent throughout the report, 
e.g., significant will always mean statisj^Lsalljt significant. 

An example of such a display of a color scheme is inserted below 
for clarification. 

Color Scheme Display of Exercises and Performances 

Aget 9 Size and Type of Community » Rural 
Color Scheme I Knowledge of Institutions (Structures and Rights 

and Duties) 



Delta P 
Values 


National 
Percentages of 
Success (Raw P) 


Exercises* Short Text 


4.20* 


88.93 


Unre leased text 


3.03 


35.92 


Which Job Hlth Dept - Insp. Rest. 


0.33 83.18 
(mediant 0.220) 


Unreleased text 


O.U 


73.82 


Who Responsible Fair Trial/Judge 


-A. 83 


57.54 


Who Head Town Gov/Mayor 


-8.49* 


46.85 


Unreleased text 



In this short color scheme, rural 9-year-olds performed typically 
at a level very near the National Raw P. The performances on the two 
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exerclses nearest the hypothetical median (Medians must be computed in 
even numbered lists In order to make a 50-50 split) are only .11 and .33 
above the National Raw P. A group's typical performances do not have 
to be close to the National Raw Ps, of course. The reference point for 
the judgment of typicality Is the group's own median, the -taost typical" 
performance In the color scheme. Typical performances are contained 
within calculated limits on either side of the group's median. It Is 
possible for all of a group's performances to lie within the limits of 
typicalltyi ordinarily, however, at least a few extreme scores In a 
group's dispersion on a color scheme are judged to be atypical. The 
best performances In the example, In which the rural 9-year-olds are 
A.20 and 3.03 percentage points above the National Raw Ps, are better 
than their typical performances. Ukewise, their worst performances, 
8.49 and 4.83 percentage points below the National Raw Ps, are worse than 
their typical performances. 

Furthermore, the two extreme Delta P values of -8.49 and 4.20 are 
flagged by the computer as being significantly different than the National percen- 
tages for the exercises. The two Delta P values of -4.83 and 3.03 are 
merely chance variances from the National percentages. While statistically 
significantly different scores normally appear at the low and high ends of 
a dispersion, significance Is a function of the size of the Delta P score 
on an exercise, not of the dispersion figr se . A group's performances on all 
the exercises In a color scheme could be significantly better or worse than 
the National performances on the exercises. Thus, a Delta P value may be 
typical and significant, typical and not significant, atypical and significant, 
or atypical and not significant, 
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The Wiley reader of statistics will have Inferred by now that an 
assumption of relatedness of exercises must be nmde to support the 
assertions of typicality and atyplcallty In all cases. The existence 
of a valid color schene Is the foundation of all such group suanarles. 
Statistically, the most valid color schemes would be produced by factor 
analysis. Then one could tell operationally which exercises go together, 
NAEP has toyed with this notion, but color schemes to date. Including 
the two Involved here, have content validity only. That, too, could be 
enhanced with the help of a few llke-mlnded experts, Hunkln»s paper 
offers a surfeit of visual judgments on which exercises In the Social 
Studies Assessment and Citizenship Assessment are valid candidates for 
their designated offices. Also Chapln»s paper reports jury decisions 
that relate to exercise vallalty. Neither of these reports was avail- 
able, however, when the judgments on these two color schemes were made. 
To the extent that this researcher's decisions effected these groupings, 
no appeal was made to a wider expertness. That lonely culpability not- 
withstanding, the schemes are not precisely as requested! 5o help came 
from somewhere, 

A final comment on the presentation of group data In a color scheme 
concerns the dispersion of Delta P values on either side of the typifying 
median. Earlier we explained the NAEP convention of using the median 
value In an ordered array of exercise performances as the most typical 
performance of a group. It was also suggested In that discussion, that 
pegging the "group effect," ••median value. •• or "typical performance." of. 
say, 13-year-old Blacks at 11,22 percentage points below the National 
percentage of success for all 13-year-old8» Is a useful but Incomplete bit 
of Infotaatlon. Ihe median Delta P tells us nothing about the dispersion 
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of Delta P values above and below that median value. 

The median value example cited above (Delta P » -11,22%) will 
illustrate the usefulness of also noting the range or dispersion of 
Delta P values. In the color scheme involved in that instance, there 
are 26 exercises. For the entire listing of 26 exercises the group 
effect (median Delta P) of 13-year-old Blacks is 11,22 percentage points 
below the National Raw P, However, the poorest performance of this 
group on any exercise in the list was 28,98 percentage points below the 
National Raw P. At the other end of the scale, the best performance 
for the group was on an exercise where it scored 7.52 percentage points 
above the National Raw P, The median and range can be shown in some 
such display as the following! 

Lowest Delta P Median Delta P Highest Delta P 

-28.98 -11,22 +7.52 

While none of the displays in this report include this dispersion 
information, frequent and consistent references are made to the extreme 
limits of the distributions in the interpretive discussions. The highest 
and lowest Delta P values are often atypical in that they depart farthest 
from the median Delta P, 

Limitations of the Dat.; t 

What with all the complexities of treatment, one would presume that 
a wealth of hypotheses could be invented about youth, learning, schools, 
and cultural effects in this country from the NAEP data. Numbers of 
observations and complexities of treatment notwithstanding, the wealth 
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available is extractable primarily through the loosest kind of inferring. 
In the statistical world, trade in loose inferences is bearish. More- 
over, NAEP, being a political creature, is constrained froro engaging in 
such creative hypothesizing. 

More specific to the point here, it is the nature of the data that 
poses the harshest limitations. Primarily what we have here are disjunc- 
tive data, to coin a phrase, rather than conjunctive data, to coin another} 
and they are disjunctive in several ways. 

First, as explained earlier in this paper, the grand sample of, say, 
25,000 persons in an age group turns out in the real world to be a com- 
posite of, say, 10 sub samples of 2,500 persons each. An assessment in 
a subject area may be comprised of 250 exercises. However, no one per- 
son and no one sub sample takes that sort of test} instead in the real 
world each works with only 25 social studies exercises. Uter they are 
quilted together to compose the Social Studies Assessment. Given the right 
assumptions about sub and grand sample randomness, sub and grand test re- 
liability, exercise validity, etc. and the right and properly rigorous 
statistical controls, this disjunctive approach can produce some reliable 
knowledge of a gross sort. This sample and test disjunction needs to be 
kept in mind nonetheless* 

There is also a disjunction across ages that makes generalizations 
comparing one age group with another tenuous. The problem is mainly one 
of test equivalency, though all the sampling problems dealt with above 
are active here, too. tmile the big goals and objectives in social studies 
are shared by all the age groups, common sense alone dictates different 
trauslations of these goals, different activities, different content, etc*. 
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at least to a degree. Thus, while all age groups may share some questions, 
each group may have a unique combination overall and some unique questions 
of Its own. A simple display of the Rights and .Duties color scheme uti- 
lized In this paper will Illustrate the problem. The color scheme a** a 
whole Is comprised of 22 exercises, variously shared by the different age 
groups. 

Exercise Distribution in Rights and Duties Color Scheme 

Exercise, 1 2 3 4. 5 6 7 8 9 10 11 12 13 U 15 16 17 18 19 20 21 22 
Age 9 X 

13 ^ ^ X X X X X X XXX 

Age 17 XX X X X X X X X X X X X X X X X X X XX 
Age Adult XX xxxxxxxxxxxxxxx xxx 

Cross-age conclusions between 17-year-olds and Adults present the 
least difficulty; the color scheme for them Is substantially equal. But 
cross-age inferences between ages 13 and 17 must be drawn from half the 
number of exercises, a dubious equation at besti and nothing useful can be 
said about 9-year-oid respondents. 

Though the data are superfluous to the point, we will display the 
exercise sharing for the other color scheme, "Knowledge of Structures," as 
a handy check point for Interested readers. 

Exercise Distribution In Structures Coler Scheme 
Exerclsei 1 2 3 4 5 6 7 8 9 10 11 12 13 U 15 16 17 18 19 20 21 22 23 2A 25 26 
Age 9 X x X X 

X 

Age 13 X X XXX 



xxxx xxxxxxx 

X X X X X X X 

A8e Adult X X X X X X X X X X X X X X x x x x x x . 



^«1^ * * xxxxxxxxxxxx 



As we have shown in several waysy though without a formal layout^ 
the NAEP data are broken down for each age group in a variety of inter- 
esting and pertinent ways. As a starting point for this discussion^ we 
will display these breakdowns. 



Categorical Breakdown of NAEP'AsMssment Data 



National 



Region 



Sex 



Southeast 
West 
Central 
Northeast 



Male 
Female 



Race 

Black 
White 
Other 

Parents* Education 

No High School 
Some High School 
High School Graduate 
Post High School 
Unknown 




Size and Type of CoBMunity (STOC) 

Low Metro 
Extreme Rural 
Small Place 
Medium City 
Main Big City 
Urban Fringe 
High Metro 



These categories* with the help of the inset nap of the United States i> 
are presumably self explanatory with ttm exception of Size and Type of 
Coonunity (STOC)« Because the definitions of these seven STOC categories 
are fairly technical and involved* the NAEP designations are attached as 
Appendix A in this paper* Readers are urged to check these with some care 
since they represent a propitious blending of geographic and socio-economic 
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concepts. 

Now» back to our main point about the dlsjunctlveness of these data. 
Each of the age groups, 9, 13, 17, Adult » is categorlzable in each of the 
ways shown in the display. Thus» we can show the percentage of success 
(Raw P) of all 9-year-oldiS (National )» for exanple» on any exercise dls- 
Ignated for 9-year-olds and the group effect (median Raw P) and disper- 
sion of all 9-year-old performances across a color scheme of exercises. 
F^rther» we can show these same statistical pevfomanctfs (Raw ?, nedlan Raw P^ 
etc.) for 9-year-olds who live in the Southeast » M^who are Males » or 
who are Blacky or whose parents have not gone to high school » who 
live — more accurately* who go to school — In a Low Metro conmunlty. 
The repeated use of the disjunctive 'cnr* in the sentence dramatizes the 
disjunctive data problem. We cannot show by these data the performance 
of Southeastern* Black* Male 9-year-olds whose parents have not gone to 
high school and who go to school In a Low Metro commnlty. In fact no 
cross category combinations of any kind are available in these data. 

This Is not a limitation of which NAEP is unaware. It has* in fact* 
contemplated future assessments in which some such combinations are en- 
tailed. On a national scale* however* the difficulties are awesomei on 
a regional scale* they are only horrendous. A major part of the problem 
relates to sample size and to the inferring of population facts from 
saiV>le data. A hypothetical case will Illustrate the point* Suppose 
there are 25*000 9-year-olds in the grand sample* Only 2*500 of these 
youngsters would be administered a given exercise. Perhaps 660 of this 
group would live In the Southeast and only half of these* 330* would be 
Males. In the Southeast perhaps a third* 110* would be Black and certainly 
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f«wer than half* $5, would have parents who never attended high school. 
Ftnallr* possibly less than a fifth of these would be categorlzable as 
Low Metro. That would provide a sample of a dozen or so* and possibly 
fewer* from which to infer population facts. The confidence level of 
one* 8 statistical inferences would be low. Whether* for all the bother* 
it would Improve on pure guess is open to speculation. 

With this examination of the data producing machinery and the 
nature of the data produced* we will turn to an examination of the data 
themselves. Our displays and discussions will make use of the concepts 
and information explored in this first part. 

II A Review of the Data in the Rational Assessment of 
Educational Progress in Social Studies* 1971-1972. 

Me begin our discussion of the results of the Social Studies Assess- 
ment with reference to the three basic displays of group effect in Figure 
1* Figure 2* and Figure 3 i^iid their associated tables* Table 1* T^ble 2* 
and Table 3. The values shown in these six locations are median Raw P 
values. In Figure 1 and Table 1 the group effect is shown for each age 
group in the categories of Nationali Southeast* Northeast* Central* and 
West region} Black and White raceiHigh and Low Metro STOC; and No and 
Post High School parental education over the entire set of exercises in- 
cluded in this report. These include 6 exercises for 9-year-olds* 26 
ex«jrci8e8 for 13-y»ar-old8* 42 for 17-7ear-olds* and 41 for Adults. This 
total group of exercises is presumed to reflect the respondents* overall 
**)Kiiowledge of Institutions,** 
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Flgura 2 ana Table 2 auwttirlze the group effect for each age group 
lit the same categories as In Figure 1 and Table 1 for the color schenet 
^'Knowledge of Institutional Structures." Figure 3 and Table 3 display 
median Raw P values for the color scheme* "Knowledge of Institutional 
Rights and Duties." The results for the "Structure" theme are based on 
5 exercises for 9Tear-olds, 16 exerdaes for 13-year-old8, 21 exercises 
for both 17-year-olds and Adults. The "Rights and Duties" theme results 
are based on 10 exercises for 13-ye&r-o;ids, 21 for 17Tear-olds, and 20 
for Adults. No 9-year-old results are pMSlble here because only one 
exercise was judged to treat this theme. ^ 

\ 

Table 1 

Knowledge of Institutions - Median Raw P Values 
National* Regional* Race* STOC* Parents* Education 
Social Studies 1971-1972 



Category 


Age 9 


Age 13 


Age 17 


Adult 


National 


65.6 


65.4 


80.1 


81.1 


Southeast 


60.4 


59.7 


78.1 


74.3 

* 


Northeast 


70.4 


71.2 


83.8 


82.9 


Central 


67.6 


67.0 


81.3 


81.2 


West 


63.5 


64.2 


76.3 


80.9 


Black 


56.2 


49.8 


64.1 


63.3 


White 


67.9 


68.2 


82.8 


83.6 


Hi Metro 


71.3 


77.6 


87.8 


87.9 


Lo Metro 


57.1 


57.1 


72.2 


69.6 


Post H S 


70.0 


74.4 


86.4 


89.1. 


No H S 


55.7 


53.6 


68.2 


70.8 
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Median AG£ 

RAW P % NINK THIRTEEN SEVENTEEN ADULT 

100 - 

98 - 

96 ~ 
94 - 



92 - 
90 - 




46 . 
44 - 
42 - 

AO «, « 

Figure 1 

Knowledge of Institutions Median Raw P Values 
National^ Kegional> Race> STOC, Parents* Education 
Social Studies 1971-1972 
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Table 2 

Knowledge of Institutional Structures - Median Raw P Values 
National, Regional, Race, STOC, Parents' Education 
Social Studies 1971-1972 



Catepiory 


Ape 9 


Ape 13 


Ape 17 


Adult 


National 


73.8 


53.7 


72.7 


74.4 


Southeast 


72.8 


50.3 


68.7 


71.4 


Northeast 


7A.1 


60.4 


75.9 


. 76.6 


Central 


75.2 


52.8 


77.3 


76.8 


West 


72.7 


55.2 


69.4 


74,4 


Black 


67. A 


45.6 


58.1 


50.5 


White 


75.A 


55.0 


76.3 


78.9 


Hi Metro 


78.A 


59.0 


79.2 


84.6 


Lo Metro 


67.1 


51.1 


65.8 


57.1 


Post H S 


77.6 


58.9 


81.5 


84.8 


No H S 


66.9 


46.7 


57.3 


64.3 



Table 3 

Xnovltdge of Institutional Rights and IHitUs - Median 3«ir t VSalmi 
National, Regional, Race, STOC, Parents* Education 
Social Studies 1971-1972 



National 


76.6 


80.6 


81.3 


Southeast 


73.2 


81.5 


74.5 


Northeast 


80.5 


87.5 


85.0 


Central 


77.1 


82.9 


82.9 


west 


75.0 


77.6 


82.8 


Black 


59.0 


73.5 


68.7 


White 


80.1 


84.6 


84.1 


HI Metro 


85.9 


88. 2 


90.6 


Lo Metro 


61.4 


80.2 


70.6 


Post H S 


86.1 


88.5 


89.8 


No H S 


58.6 


73.3 


73.5 
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Median 

RAW P X 



AGE., 

NINE 



THIRTEEN 



SEVENTEEN 



ADULT 




,.POST H S 
CHI METRO 



WHITE 

CENTRAL 

NORTHEAST 

NATIONAL 
WEST 

SOUTHEAST 



NO H S 



LOW METRO 



BLACK 



Figure 2 

Knowledge of Institutional Structures - Median Raw P Values 
National^ Regional, Race, STOC, Parents* Education 
Social Studies 1971-1972 
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Median 

RAW P % 

100 
98 
96 
9A 
92 
90 
88 
86 
84 
82 
80 

78 
76 
7A 
72 
70 
68 
66 
64 
62 
60 
58 
56 
54 
52 
50 
48 
46 
44 
42 
40 



AGE,, 

NINE 



THIRTEEN 



SEVENTEEN 



ADULT 




HI METRO 
POST H S 



NORTHEAST 
^ WHITE 
^ CENTRAL 
1 WEST 
NATIONAL 



SOUTHEAST 
NO H S 

LOW METRO 
BLACK 



Figure 3 

Knowledge of Instittutional Rights and Duties - Median Kaw P Values 
National* Regional* Race* STOC* Parents* Education 
Social Studies 1971-1972 
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GeneraUzing from these data in Figures X, 2, and 3 and Tables 1, 
2, and 3 is a bit hazardousi but to be perfectly honest and open, one 
aust say that for every display. Rather than repeating it endlessly, 
we will assume that all will proceed from this point with caution. 

The striking feature of the three graphs is the general configura- 
tion Of lines. If we could make an assumption of test equivalency 
across the four age groups - which, of course, we cannot - we could 
say that the years between 9 and 13 are something of a loss for young 
persons in the U.S. as far as this aspect of social studies is concerned, 
but the social and political world comes alive for them sometime after 
age 13. By age 17, then, most will have learned all they ever will, as 
many will lose in their adult life as will gain in knowledge of the 
political and socUl institutions that govern their lives and their 
rights and duties within them. While a number of constraints will not 
allow us to base so strong a statement on these data lone, we suspect 
the hints are Indeed there and something like this is In fact the case. 
Even discounting the results at age 9, which are probably spurious due 
to the few exercises, we are left with the dramatic rise from age 13 to 
age 17 and the noticeable cooling off after age 17. The sets of exercises 
given to 13-year-olds and 17-year-olds are only marglmiiijr comparablei 
but there Is near equivalency betwoen the 17-ye.r-old and Adult exercises. 
A similar, but less pronounced rising and cooling effect is evident In the 
earlier Citizenship Assessment for some groups, principally Males (page 
9), Medium Size Cities, Urban fringes, and Smaller Places (pp 40-41), on 
a simiUr theme, (Citizenship, Group Results A, 1971, Report 6). 
So, by rounding, squinting, and allowing in several ways, we can 
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probably say that something is fairly successful in increasing young 
persons' knowledge of institutions by as Much as 2531, in relative terms, 
between ages 13 and 17 (an absolute gain of about 15 percentage points 
in these data). We may also be able to say that schools in general and 
social studies in particular play some part in this growth. Most stu- 
dents have almost two years of U.S. history and one year of government 
between ages 13 and 17. That does not suggest that there are grounds 
for pride in this rough calculation, however. A good part of the in- 
crease may be accounted for by Piagetian hypotheses concerning the 
general shift from the concrete operations stage to the formal operations 
stage of cognitive development in this age range. Understanding of this 
content and interest in it may be as much products of development as 
schooling. 

We infer the effect of schooling on what apparently happens to 
persons when they leave school. They retain, at least in part, what they 
learned as teen-agers ten years or so earlleri but they do not continue 
to grow. Now, of course, a statement like that is not warranted by these 
data. We know absolutely nothing about these particular 25-35-year-olds 
when they were 17 except by inference and conjecture. 

Ihey were bom between, say, 1937 and 1947 and half or more would 
have graduated from high school between 1954 and 1964 at about 17 years 
of age. Schools were not much different then from 1971-1972 when this 
assessment was made. Furthermore, these young adults knew something of 
WW II, or at least its aftermath, and lived through Korea and Viet Nam; 
some served in the armed forces there or elsewhere. They saw their 
president and his assassin killed on television and watched the whole 
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panorama of strife and dissent throughout the sanguine 60»«. Some would 
have voted a dozen tines perhaps. 

Therin lies a tragedy that these data suggest, teaming in this 
country, at least as it measured by these exercises and as it concerns 
this content, stops at the schoolhouse door, not, as seme have insisted, 
on the way in, but on the way out. Schoolnen still have no certain 
grounds for pride here, however i for what is learned in schools and, con- 
sequently, what is being assessed here by N/^EP nay be so irrelevant to a 
citizen's life purposes and activities that he has no reason to learn 
any note of it. Also what is being noted here as learning nay be a con- 
sequence of experiences at a certain age, but not necessarily school ex- 
periences* 

Another tragedy is depicted by Figures 1, 2, and 3 and Tables 1, 2, 
and 3. The gross differences and inequalities in our society that attend 
race and class, for the most part, are part and parcel of schooling, 
learning, and testing. That, of course, is hardly a startling revela- 
tion, Everybody knows that the racist and classist biases in this so- 
ciety are pervasive. They operate in schools quite as easily as any- 
where, despite 20 years of desegregation experience. However, buried in 
the tangle of lines in Figure 2 is the whisper of a hypothesis that, 
assuming a part of the difference between 13 and 17 is a schooling effect. 
Blacks and the poor may get senething of a break in schools. While the 
Blacks, the Low Metros (these are mainly the inner city poor and probably 
are largely Black), and those whose parents never attended high school 
have the three lowest median Raw P values of all 13-year-old groups 
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(around 60X) in the Rights and Duties color scheme, they show the most 
precipitous gains by age 17. The Low Metro groups show a 20 percentage 
point sain between age 13 and age 17| the Black samples and the No High 
School samples show 13 and 15 point differences. The National difference 
is only 4 points and no other group gained more than 8.32. The gains of 
the Uw Metro, No High School, and Black groups may be more of a function 
of starting points, it is much easier to post gains with a starting 
point of 59X than it is with a starting point of 77Z. Their gains are 
short lived, howeverj in the adult world, the Black and Low Metro cate- 
gories, along with the Southeast region show group disadvantages of from 
6 to 12 percentage points below the National median. 

An alternative hypothesis may be more powerful. These 17-year-old 
Blacks in 1971-1972 had been witness to and had probably participated in 
a dramatic civil rights revolution in our society throughout their school 
life. They, more than most, would have been sensitized to such issues 
since 1954, the year in which some of them were born. In this hypothesis, 
the schools can claim no credit, for it was these young 17-year-olds who 
brought the pertinent concepts to the school) they didn't learn them 
there. 

There is also the possibility that the gains for Bl..oJc, No High School 
and Low Metro groups reflect a condition noted in other studies, e.g., the 
ColumbU University Citizenship Education Project, that Black youths and 
some others learn more about politics and the like in school because they 
have less opportunity for formal learning about institutions outside of 
school than do White, middle-class youths and scne others. 
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III Comparison of Group Differences 
from National Success Levels in Social 
Studies and Citizenship Assessments 

In the following displays and discussions, group performances will 
be reported as Delta P values for individual exercises and median Delta 
P values for groups of exercises or color schemes. When Delta P values 
are used, the performance of a selected group is shown as deviating by 
so many percenuge points above or below the National Raw P value on a 
given exercise. In the figure displays in this section, we will adopt 
*n NAEP convention by showing the National performance levels as lying 
along a horizontal line designated as 0. It is not useful to Identify 
National Raw P values in the figures since the median Delta P values 
charted in the figures for two or more groups at any age level most likely 
report scores on different exercises. Figures simply display the typical 
performances of groups. The performance level of the groups involved will 
be charted as broken lines which connect the median Delta P values for 
each age level above and below the 0 National line. The following is an 
example of this convention. 

Figure X 
Knowledge of Institutions 
Regions - Median Delta P 

NINE THIRTEEN SEVENTEEN a/JULT 



X 

ABOVE 



WEST 
CENfRAL 



NATIONAL 



X 

BELOW 
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Accompanying each figure will be a table on which the numerical 
values are displayed as below. 

Table X 
Knowledge of Institutions 
Regions - Median Delta P 

Age 9 Age 13 Age 17 Adult 

NATIOHALMJED.Z 65.6 65.4 80.1 81.1 

WEST -2.1 -0.8 -1.8 1.7 

CENTRAL 2.0 0.7 0,9 1.6 

On the top line of each of these tables will appear the National median 
Raw P value for each age group. It is useful only as a general reference 
point to typify the performance level of the total age sample. There is, of 
course, a different set of National median Raw P values for each color 
scheme. These were shown in Figure 1, 2, and 3 and Tables I, 2, and 3. 

Readers should be warned that the National median Raw P values 
(National Med Z) cgnngt be used in conjunction with the median Delta P 
values reported in the tables to calculate the groups* Raw P values, say, 
for Central or West Adults in Table X. The reason this operation cannot be 
performed is that the score 81. U indicates the percentage of success of 
all Adults on a specific exercise which lies in the middle of a distribution 
of exercises (or the hypothetical middle score if there is an even number of 
exercises). The West and Central Adult median Delta P values of 1.7X and 1.6% 
indi«a$e cheir hypothetical middle scores or their successes on the specific 
exercises which lie in the middle of their own distributions. Since each 
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distribution is independent, there is little chance that the three 
scores reported refer to the same exercise. 

In Figure X and Table X, the Central region 9-year-old8 are 2 per- 
centage points above the National Raw P on their median exercise while 
Western 9-year-old8 are 2.1 percentage points below the National level 
on their median exercise,etc. In our subsequent discussions, we may, 
for convenience and relief, use shortened versions of such statements, 
e.g.. Central 9-year-olds are 2% above the National percentage while West 
9-year-old8 are -2.1% below. 

Our first set of figures and tables will depict the performances 
of selected groups on the total number of exercises included in this 
report. The references will be to "Knowledge of Institutions" which is 
treated here as a color scheme of related exercises. In four instances 
it has been possible to make some general comparisons with the NA£P«s 
Citizenship Assessment made in 1969-1970. Goal 0 of the Citizenship 
Assessment objectives, "Knowledge of Ckwernmental Structures and Functions," 
is similar to the overall color scheme, "Knowledge of Institutions," used 
as the basis of this report. There are several difficulties with the com- 
parison, not the least of which is that the Citizenship Assessment results 
are reported in such enigmatic ways that many values simply cannot be 
found and all are rounded estimates for group results. The major diffi- 
culty, of course, is the doubtful fit of the two sets of exercises. 
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Figure U and Table 4 depict the performances of the four age groups 
on all exercises in the regional categories. The Figure 4 display shows 
very little variance among the four regions, though on most of the exer- 

^ cites, the Southeastern Adults are significantly below the National level. 

ERJC 
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This is the most dramatic difference in the figure, though the differ- 
ence between Northeastern and Southeastern 13-year-olds is exactly the 



same as the difference between the Adults in the two regions. 

Table 4 

Knowledge of Institutions - Regions 
fiatSfiorir Age 9 A«*i 13 


Adult 


National Med. X 


65.6 


65,A 


80.1 


81.1 


Northeast 


2.0 


3.6 


3.3 


2.3 


Central 


2.0 


0.7 


0.9 


1.6 


West 


-2.1 


-0.8 


-1.8 


1.7 


Southeast 


-3.3 


-3.9 


-3.1 


-5.2 



The real puzzle in Figure A and Xible 4 lies with the Western 17-year- 
olds and Adults. At 17, all but 5 of the 42 exercises included here are 
below the National percentagesi a fourth are significantly below. Among the 
Adults, 802 of the exercises are above the National percentagesi and a 
fourth are significantly above. Perhaps the high scoring Northeastern teen- 
agers of a decade ago moved West. That hypothesis is of dubious quality, 
obviously; at least, the pattern does not show up in the Citizenship Assess- 
ment of 1969-70, which is displayed for regions in Figure 5 and Table 5. 
The same general, fairly flat configuration of Figure 4 is apparent also in 
Figure 5 with the Northeast and Central lines lying wholly above the 
National percentages and with the Southeast lying wholly below. The drama- 
tic rise in the West from -0.5 at age 13 to 1.7 at age 17 is not altogether 
different than what occurs between age 17 and Adult in Figure 4. 
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Figure 4 
Knowledge of Institutions 
Social Studies 
1971-1972 
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Figure 5 

Knowledge of Governmental Structureik 
and Functions - Regions 
Citlaenship 
1969-1970 
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Aite 9 


- Ate 13 


Aiic 17 


* 






3.0** 


1.7 


1.5 


0.0 


0.5 


1.5 


-0.3 


-0.5 


1.7 


-X.5 


-3»0 


-5.5 



Adult 

1.0 
0.8 
1.0 
-3.5 



Table 5 

Knowledge of Governmental Structures and Functions - Regions 

Citizenship 1969-1970 "egions 
MWIlan Delta P 

Category 

National Med X 
Northeast 
Central 
K'est 

Southeast 

* Not reported 

** Sstlaated fron EWilblt 3-7. d lit. c4i.4.**-k4^ 

6t JMly 1971. « ^» P Citizenship group atsultf a. Report 

Bace 

Figure 6 and Table 6 show the perfon^Ulnces of the four age samples 
on all exercises as categorized by Black and White races, acduded fr« 
these displays are about 125-220 persons In each of the sub sa-ples of 
8o«e 2.500 persons who were classified as "Other." The "Other" category 
include. Orientals, who qualify as racially distinct, and .Me ethnic 
groups Who do not. The category Is too Indistinct to characterize accur- 
ately and too small to Include In this breakdown. In the KAEP testing 

Table 6 

Knowledge of Institutions - Race 
Social Studies 1971-1972 
Median Delta P 




National Med. Z 

Black 

White 



65.6 
-12.2 
2.3 



65.4 
-U.3 
1.8 



Adult 



«>-l 81.1 
-13.5 -18,4 

2.8 2.9 



«.t«. in new. r^t U p.n « ^ 
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cateswy. All field administrators do not share the sane definitions of 
race. Also Included here In Table 7 and Figure 7 are the group results 
for Blacks for Goal D in the 1969-70 Citizenship Assessment. Neither 
National percentages nor White median Delta P values are reported by NAEP 
for the Citizenship Assessment. Nonetheless, the results are obviously 
tragically clmllar. 



Table 7 

Knowledge of Governmenual Structures and Rinctlons 

Citizenship 1969-1970 
Median Delta P 



- Race 



Category 

National Med. X 

Black 

White 



ARe 13 

•k 



•10.0** 



-13.0 



te 17 



-15.5 



Adult 



-17.0 



* Not reported 
** Estimated from Exhibit 3-9, 
P* 64 Citizenships Group 
Kesult, B Preliminary Report 
9, May 1972 

As shown In T&ble 6, the success difference between the Whites* and 
Blacks* median Delta P values at every age level Is from UX to over 202. 
lUe exercise story Is the same at every age level. At age 9, the Whites 
have six out of six exercises significantly above the National percentages, 
the Blacks have six out of six significantly below. At age 13, the Whites 
have 24 out of 26 exercises above the National percentages^ 18 of them 
slgnlflc.r.iy above. The Blacks, on the other hand, have 23 out of 26 
exercises below the National percentage^ with 20 significantly below. 
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NhU. 17Tr«r.oUs hav, 39 of 42 «,rct... .bor. tte National petcmitage. 
While the BUCK n-y^v^u, h.v. 40 of 42 ««»U,. below. Of tl».e 37 
«. .twlflcantly abov. for Mhlte. and 36 at. .Igntflcantly bolow for 
BUcka. Adult Hhlta, tav, 39 out of 41 above and Mult BUcka hav. 39 
out of 41 b.lo» the National percentage* All but one Delta P above and 
t«» beloK are atatlatteally .Ignlf leant. On several Individual exercise, 
.t the Adult level and on a few at oth«: level., the dlffer««. befeen 
BUck and Hhlte Raw t value. I. «,re than 30!{. In one oaee the differ- 
ence I. nearly m, . «hlt. Adult, In that ca.e, 2% tfe. .»r, Ukeiy 
to anawar correctly than a Black Adult. The pattern ...rge. of two racUl 
group, m tht. country dr«»tlcally and tragically dlv«:.e In their know- 
ledge and under.t.«ltne of the baale legal and political Inatltution. 
that ord«r and protect their live, m Intmotlon., a. M.,ur.d bv >h<. 
WAEP a.»e.w«nt. 



Parent.' Sdueation 



Table. 8 and 9 and Figure. 8 and 9 dtapUy brwUtdown. of the SoeUl 
Studle. A..e..«ent re.ult. on Inatltution. wuJ the earU«r CltUenahtp 
Asaeauent reault. on Oovernaenlal structure, m Function. (Goal 0) by 
Parent.. Education. A re.ponde«t wa. placed In the Pet High School cat- 
egory If one or both of hi. parent, attended sew school beyond high 
eehool, In the High School Graduate category if or both of hi. parent, 
graduated from high .chool, t„ the Some High School category If one or 
both of hi. patent, attended high .chool, but neither graduated, and In 
the Ho High School category If neither parent went to school beyond the 
eighth grade* 

It is well known that father's education ha. l^wrttnt .ocUl cU.. 
—berehlp effect, m tht. .oeletr, .0 that kind of dlffar«.tUtt«. I. 
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Table 8 



• 

Cateftorv 


Knowledge of Institutions - Parents' Education 
Mb 9 Ace 13 Apf, 17 


A/f 111 f* 


National Med. 


Z 65.6 


65.4 80.1 


81.1 


Post H.S. 


4.7 


6.3 5.3 


8.6 


HS Qrad 


2.4 


"'0.3 -0.2 


2.9 


Some H.S. 


-6.3 


-6.0 -5.7 


-2.1 


No H.S. 


-8,1 


-10.7 -13.2 


-9.2 



Table 9 

Knowledge of Governmental Structures and Functions - Parents' Education 

Citiaenship 1969-1970 
Median Delta P 




National Med. % * 



Post H.S. 


10.0** 


8,5 


9.5 


8,0 


H.S. Grad 


2,5 


2,0 


3.5 


1,5 


Some H.S. 


-4,5 


-2,0 


-6.0 


-1,0 


No H.S, 


-8,0 


-8.5 


-7,0 


-9,0 



* Not reported 
** Estimated from Exhibit 
2-16, p. 32, Citizen- 
ship I Group Results B. 
Preliminary Report 9, 
May 1972 

obviously mkiiig in these arrays* A dittinetive characteristic shared by 
the two data sources Is the absolute and heirarchical discreteness of the 
categories across the age levels. The lower education groups never close 
the gap. The Sone High School Adults show a ptecipitous gain in Figure 9$ 
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Wer, thtt would be interesting to explore. It could reflect nothing 
««re than a chance eanpUng fluctuation, but In the «ld8t of the paralle- 
Xlw otherwise exhibited In this display, the result, of this category 
across the age levels are ano«olou8. The parallel upswings of all Mult 
categories In Figure 8 will be looked at «ore specifically in the analyses 
in the next section of this report. 



Size and Type of Cflanuni^y 

The exhibits In Tables 10 and 11 and Figures 10 and 11 are also re- 
lated in that they show the two sets of data categorized by Size and Type 
of CoMKinity. The officUl definitions of these categories are included 
in this report, as nentioned earlier, in Appendix A. These categories 
also have heavy socio-econonlc effects in that High Metro is aalnly an 
affluent grouping! Urban Ftinge is suburbanite, presumably aiddle cUss 
Awrlcai Rural is priaarily a fara population, and low Metro is inner 
city, thus aalnly, though not exclusively, city Black. 



Table 10 



ERIC 



Knowledge of Institutions - STOC 



Category 


Age 9 


Age 13 


Age 17 


Adult 


National MM. 2 


65.6 


65.4 


80.1 


81.1 


Hi Metro 


A. 8 


8.8 


7.0 


7.9 


Urban Fringe 


1.8 


l.A 


1.9 


2.8 


Rural 


0.2 


-3.5 


-4.3 


-3.6 


Lo Metro 


-11.9 


-6.9 


-6.1 


-11.9 


It is tempting to overwork these data and 


to extend unreasonably 



assuaptiens of reliability and validity. But without invoking validity, 
it seens warranted to say that the exercises used in the 1969-1970 
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Category 



Table 11 

Knowledge of Governmental Structures and Functions - STOC 



Age 9 


Age 13 


Age 17 


Adult 










6.0** 


5.0 


5.5 


10.5 


0.5 


1.5 


1.0 


0.0 


-4.5 


-4.0 


-3.5 


-5.5 


-17.0 


-8.5 


-9.0 


-11.5 



National Med* X 
Hi Metro 
Urban Fringe 
Rural 
io Metro 

* Not reported 

** Estimated from Exhibit 
^-14, p. 97, Citizen- 
ship Group Results B, 
Preliminary Report 9, 
May 1972 

Citizenship Assessment and those used in the 1971-1972 Social Studies 
Assessment discriminate among these STOC groups in the eight age samples 
involved in very similar ways. The four community types selected here 
actually include only about 45% of the datai but for the Social Studies 
Assessment, the remaining results for Main Big City, Medium City, and 
Small Place are all within 1.5Z of the National percentages, most are less 
than 0.5X. in the Citizenship Assessment, all but two of the results not 
shown on Figure and Table 10 are less than 2.5Z. The high variances are 
Included in these dispUys. They are unquestionably sensitive to socio- 
economic influences. 

Though in the next sections, where the two social studies color 
schemes will be treated separately, we will treat the validity question 
more explicitly, it is transparent here, jLl wg. assume test validity, that 
the social classes in this country vary greatly in their knowledge and 
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understanding of the institutions they live by. Before this classist 
hypothesis is enbraced» however* one should attend carefully to the 
judgments reported by both larkins and Hunki«s concerning the validity 
of objectives and exercises con^rlsing the NAEl' Social Studies and 
Citizenship Assessments. larkins* in particular suggests the presence 
of social class effects In these assessments! but they are at least as 
evident In the assessors as in the assessed. Schooling* we might Infer 
from the squeezing of the variance that occurs at age 13 and age 17* has 
sone effect toward leveling) but once the Influence of the school Is 
gone* the Influences of the wider milieux surface. Mostc of the High 
Metro Adults will have gone to college | and most of the Lew Metro Adults 
will not. That In Itself could account for some difference. Either the 
exercises are so profoundly culturally biased that the lower classes 
have a bullt-ln content and language disadvantage while- the upper classes 
have bullt-ln advantages i or the reading* conversational* and viewing 
habits* along with other traits* of the High and Low Metro groups are so 
diverse that matters attended to In one are more In line with what these 
exercises refer to while the matters attended to In the other are outside 
this realm. 

But these two explanations are the same. They both say that appar- 
ently the content of these questions is reinforced by the experiences of 
one group after school and not reinforced by the experiences of the other. 
From this point on the consideration becomes normative. One may say with 
Robert Coles that the effects of the inner city are pathological and 
possibly with James Coleman that one set of values Is more appropriate for 
life in this countryi or one may say that neither NAfil* nor any other white 
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middle class organization schools, for example — can observe, teach, 
or assess the lower class in this country with accuracy and fairness. 

In the following section we will analyze the social studies data by 
the two smaller color schemes with more reference to individual exercises. 



Results reflecting the performances of the four age level samples 
and analyzed by Region, Sex, Race, Parents* Education, and Coamunity Size 
and lype for the two color schemes. Knowledge of Structures and Knowledge 
of Rights and Duties, are displayed in Figures 12 through 21 and Tables 
12 through 21. The same statistical treatment is used, l.e,. National 
percentages are shown in figures as 0 and group effects on 
color schemes are shown as median De^ta P values i however, each color 
scheme Is based on only a portion of the total number of exercises. The 
presumption Is that each of these color schemes Is more precisely homo- 
geneous than the total group of exercises. That, of course. Is a visual 
judgment and may be checked In Appendix B where the texts of the released 
exercises, the topics of the unreleased exercises, and color scheme member- 
ship are shown. The results In this section are based on the following 
nxtmber of exercises t 
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Regions 

The first set of figures and tables in this section is made up of 
Table 12 and Figure 12 which display the Structure color scheae and 
Table 13 ar^l Figure 13 which display the Rights and Duties color scheme 
for each of the regional categories of Southeast, W^st^ Central, and 
Hoi*theast. 

Table 12 

Knowledge of Institutional Structures - Regions 
Social Studies 1971-1972 
Median Delta P 



Catef^^ry 


Aze 9 


Age 13 


Afte 17 


Adult 


National Med. Z 


73.8 


53.7 


72.7 


74.4 


Southeast 


-1.8 


-3.6 


-3.4 


-4.5 


Central 


2.6 


0.2 


1.7 


1.7 


West 


-1.1 


-0» 5 


-1.9 


1.6 


Northeast 


1.2 


3.2 


3.3 


0.7 



Structures. As Table and Figure 12 clearly show, the variance across 
regions for the exercises assessing structural knowledge Is snail. The 
median Delta P values are all less than 5 percentage points. Most- are 
Ittss than 2%, 



At the 9-year-otd level, the exercise showing the biggest difference 
between the Northeast and Southeast youths asked, 

"Which one of the following is usually the 
head of a governnent in a town? 

The fluiyor 

The Governor 

The Chief of Police 

The School Principal 

I don't know*** 
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Nationally, 57. 5Z of 9-year-olds know the correct answer i 48,1% of 
the 9-year-olds know It In the Southeast and 66,7% of the Northeast 9- 
year-olds know It. Both values are significantly different than the 
National percentage and both are atypical responses for the regional 
groups, A simple cultural effect nay be operating In the question due 
to the different geographic profiles of the two regions, the different 
nanes given to town heads, e.g., first selectman and town board chairman, 
and even different names for towns In some states, e.g., villages. 

At age 13, the West and Central are more alike, as populations they 
are indistinguishable, in fact, with only two atypical responses and three 
significantly different than the National percentage between them. The 
Northeast and Southeast are more different fron each other, though the 
contrast is far from dramatic. On most exercises the two groups of 13- 
year-olds are between 5 and 10 percentage points apart with the Southeast 
in all but one case being below the National percentage and the Northeast 
in all but two cases being above. They are within 3 percentage points of 
each other on a question about financing the government. The text for 
this question Is unreleased. (To provide a basis for future comparison, 
NAGP holds In secret about half the exercises used In an assessment. We 
make reference to these unreleased exercises by topic only. ) At any 
imt% Fewer than half of all 13-year-olds know the answer (National per- 
centage " 47.2). Northeastern youths have a Delta P of -1.62| Southeastern 
13-year-olds have a -4.58X. The two groups are farthest frc« each other 
on unreleased exercise on school governance. Northeast 13-year-olds are 
6.2% above the National percentage while Southeast 13-year-olds are -6.3J; 
below. 
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At age 17, the two most contrasting groups are again the Southeast 
and Northeast, though the West youths scored the lowest of all on two 
unreleased Constitutional questions to provide the greatest contrast for 
the Northeast with differences of 16 and 19 percentage points. In 
another unreleased question on foreign affafrs the Southeast perforaed 
the best, at 5t above the National percentage, while the West again Is 
lowest, at -6.1Z below the National percentage. ' 

At the Adult level, the Northeast, Central, and West are indistin- 
guishable with respect to median Delta P values. The Southeast, whose 
Adults nake the poorest showing here are below the National percentages 
on all 21 exercises by only -22 to -82. The other regions have only four or 
five results below the National percentages. None, however, is more than 
6. 82 above. 

The range of perfotmance for all Adults in this color scheme is from 
a poor National percentage of success of 45. 7Z on an unreleased exercise 
on a Constitutional provision to a whopping 96.32: on another unreleased 
question on the armed forces. About 2/3 of the entire Adult sample was 
able to answer a half dozen unreleased questions on federal government 
details. A released question, typical of these detail questions on the 
federal government, asks, 

"Which one of the following has the 
power to declare an act of Congress 
unconstitutional? 

The Congress 

Die President 

The United States Supreme Court 

The United States Department of Justice 

I don't know,*' 



ERIC 
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Nationally, 61.82 of the Adults answered correctly. Delta P values 
range from 3,0% for Central Adults to -4.5Z for Southeastern Adults. 

Rights and Duties. Table 13 and Figure 13 display the median Delta 
P values for the four regional categories on the color 8chene» Knowledge 
of Institutional Rights and Duties, for age levels 13, 17, and Adults. 
No 9-year-old results are referred to in this color schene because only 
one exercise was classified under Rights and Duties. 



Table 13 

Knowledge of Institutional Rights and Duties ** Regions 

Social Studies 1971-1972 
Median Delta P 



Catexory 


Am 9 


ARe 13 


Aice 17 


Adult 


National Med. Z 




76.6 


80.6 


81.3 


Southeast 




-5.2 


-2.5 


-7.0 


Central 




1.3 


0.2 


1.3 


West 




-2.1 


-1.7 


1.8 


Northeast 




5.0 


3.3 


3.1 



Released exercises in this color scheme involve such matters as 
athiests holding office, criticism of officials and the military by news- 
papers and others, picketing rock concerts and police, assembly in 
parks, congressmen seeking views of constituents, racial discrimination 
in employment, and laws against vandalism* Unreleased exercises relate 
to freedom of press and religion, property and petition rights, and 
government criticism. The color scheme as a whole Is presumed to In- 
quire into knowledge and understanding of Individual rights and duties 
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in several Institutional arrangements, mostly political, In this society. 

Most of the exercises in this color scheme may be Interpreted as 
assessing a respondent's commitment to some democratic values. A re- 
leased example of this sort of question asks, 

♦•Should a person who does not believe 
in God be allowed to hold a public office? 

Yes 
No 

Uhdecided." 

From that Interpretation, It seems perfectly appropriate to 
think of the set of questions as inquiring Into the democratic beliefs 
of the persons being questioned. Our own reluctance to call the color 
scheme by such names as attitudes, beliefs, and commitments is based on 
two reasons. First the exercises refer,for the most part, to rights 
and duties which are fully legal and established in this country. They 
do not present Issues that are presently the subject of hot debate In 
the society, nor do they refer to any controversial extensions of dem- 
ocracy into new areas. Second, it is very difficult to ascertain the 
actual realm of assessment with such questions. The recent literature 
on value analysis only serves to emphasize the enigmas involved. With- 
out further questioning and exploration, there is no certainty whether 
the question elicits descriptive or valuative information. 

To the credit of NA£P, additional Information has been requested on 
some of these sham questions to help insure their operation In the value 
realm. The respondents are asked to express reasons for their answers. 
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The following is a released example. 

••A, Do you think people should be allowed 
to picket the holding of a rock festival 
as a protest against it? 

Yes ( go to B) 
No (go to B) 
Undecided (go to B) 

No response (after 10 seconds, go to C) 
B. Please give a reason for your answer, 

Again, all we can say with respect to this strategy Is that it 
Is perhaps as good as can be done with written exerciser. The further 
assumption Is required, however, that the respondent's own criterion 
is being expressed when he offers a reason. Otherwise, we are back to 
square one and still uncertain whether descriptive or normative infor- 
mation is being expressed. By design, we exluded the reason giving 
parts of such questions from this kiiowle^ color scheme In anticipation 
of having another color scheme in which they would be featured. This 
value color scheme, as we stated earlier, was among those not computer- 
ized. Its absence, we recognize, places this Knowledge of Institutional 
Rights and Duties color scheme, as well as this interpreter, in a vulner- 
able condition. 

As Figure 13 clearly shows, the regions consistently maintain their 
respective positions in the area of Rights and Duties. That suggests that 
the two color schemes. Structures and Rights and Duties, are not discrete, 
i.e., they are probably measuring similar things. Nonetheless, the region- 
al groups are more spread out in this color scheme. Over 10 percentage 
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poittts saparate Northeast and Southeast nedlan Delta P values at both 
age 13 and Adult levels. The Central and Western categories at each age 
group continue to look very much alike and continue to be the nomlng 
group. Only three results among all Delta P values for both groups for 
all ages are more than 5Z above or below the National percentages. 

A selected set of exercises will illustrate how the Northeast and 
Southeast differ. The released questions are represented here by short- 
ened texts. Since the values reported in these examples are Delta P 
values and National percentages for individual exercises, rather than 
median values as in the previous displays, they are directly and speci- 
fically comparable. The Northeast and Southeast scores can be added to 
and subtracted from the National percentages. 

Northeast/Southeast/National Comparisons on Selected Exercises 
Should an athiest hold public office? 

Age 13 Age 17 Adult 

Northeast n.6 u.2 7.4 

Southeast -u.s -le.l -20.3 

National Z 59.4 52.6 55.6 



Should an athiest be allowed to express his views publicly? 





Age 13 


Age 17 


Adult 


Northeast 


7.6 


2.3 


3.0 


Southeast 


-8.4 


-4.9 


-10. 1 


National X 


63.9 


78.1 


77.9 
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Should newspapers crlt:iri9a 


public officials? 






Age 13 


17 


Adult 


Northeast 


8.4 


7.8 


2.9 


Southeast 


-8.9 


-9.3 


-7.0 


National Z 


48.9 


73.4 


81.1 



Should people be alloved to picket against a rock festival? 

Age 17 Adult 



Northeast 


6.9 


0.6 


Southeast 


-9.3 


-8.6 


National X 


52.7 


63.0 


Should People be allowed 


to assemble in parks to make 


demands? 




A«e 13 Age 17 


Adult 


Northeast 


5.6 


5.0 


Southeast 


-11.7 -4,5 


-7.8 


National Z 


63.5 87.2 


77.5 



The selected set of exercises above cannot be used appropriately 
to characterize the groups. Figure 13 and Table 13 do that more reliably. 
However, sone generalizations and contrasts inevitably emerge. 

m a country which is presumably built on democratic principles, seme 
Of those believed by many to be fairly basic fail In these exercises to 
receive anything like unanimous approval. If one prefers an alternative 
Interpretation, a great many persons who live In this country do not know 
What Its basic principles are. From another view, however, one can say 
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that 752 to 802 support for anything in a country as pluralistic as this 
one Is nothing short of miraculous. Moreover, the application of a value 
conflict nodel to these data would likely contribute to their understanding. 

Whatever generalization is preferred, it would appear fairly certain 
that a person who professes not to believe in God could not be elected 
dog catcher of Orange County, North Carolina, on a bipartisan ti«ket. 
Athiest politicians would not seem to be shoo-ins anywhere in the 
country. That exercise result, along with one about allowing persons 
to picket a police station to protest police brutality and another 
about knowing that prayer is excluded from schools on the grounds of 
church and state separation, barely made a majority among adults. 
Picketing and the Supreme Court's religion banning decision fared no 
better among the nation's 17-year-olds. Fewer than half chose the 
separation principle for the one and a bare majority would allow pickets 
to protest either police brutality or a rock festival. In the Utter 
cases, rejection of the time honored •'right** of protest over that range 
of social offenses must aean sonething. 

The three age levels were asked, 

"Should race be a factor in hiring some- 
one for a job? 

Yes 
No 

I don*t know." 

On this very important question, we take heart. Over 902 of every 
category at every age level, except Southeast and West l3-yearolds 
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and Southeast Adults know that racial dlsorimlnatlon in enployaent Is 
Illegal or believe that race should not be a factor in enployment» 
whichever interpretation one prefers. A difference between the South- 
eastern and Western 13-year-old8 is that for the Southeasterners this 
result is next to their best performance relative to the National per- 
centages. They are atyplcally high. But for the Western 13"year-old8, 
this result is their poorest performance on all Rights and Duties exer- 
cises. The Delta P value of -6.4% is significantly below t\vt National 
percentage of 88. 8Z for all 13-year-olds. 

A visual conparison of the rank ordering of exercises according to 
Delta P values, a contribution of the computer that will not be shared 
In this report, for each of the age and region groups suggests, much 
like Figure 13, that Southeast and West youth are much alike. North- 
east and Central youth have much in common, and Northeast, Central, and 
West Adults are very similar. The dramatic events which occur h% this 
breakdown of the data cross regions are the accommodation of east<^m 
liberalism by West Adults and the retrenchment of Southeast Adults in a 
conservative, Bible-belt, law-and-order posture. 

Sex 

Tables 14 and 15 and Figures 14 and 15 display the results in the 
Structure and Rights and Duties color schemes according to sex. Our 
first examination will concentrate on the Structure questions. 

Structures. Table 14 shows the National median percentage of success 
and the Male and Female median Delta P values for each age level of 9, 13, 
17, and Adult. 
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Table U 



Knowledge of Institutional Structuref Sex 
Social Studies 1971-1972 
Medita Delta P 



Categor y Afte 9 

National Med. X 73.8 

Male 0, 5 

Female -0,6 



Age 13 
53.7 
-0.2 
0.1 



Age 17 
72.7 
1.8 
-1.6 



Adult 
74.4 
3.4 
-3.4 



Figure 14 translates these median Delta P values for Males and Females 
across all ages for the Structure color scheme. According to the med- 
ian Delta P values used to characterize Males and Females at ages 9 and 
13, the two groups of young persons are not very different in their 
knowledge of the structures of institutions. In comparing the two 
groups at ages 9 and 13 on individual exercises, the similarity judg- 
ment is only partially upheld in that the two groups are significantly 
different than the National percentage ott 7 of 16 exercises at age 13 
and 2 of 5 exercises at age 9| but In none of these is the difference 
aore than 7 percentage points. So at ages 9 and 13, boys and girls are 
different in what they know, believe, or hold inportanti but they are 
not draaatlcally different. Differences this snail nay in fact be only 
chance products. 

Specifically, at age 9, Males are 52 more likely than Females to 
know that mayors and not police chiefs or school superintendents are the 
heads of tcfwns. Also boys are about 5% more likely than girls to know 
that the health department is involved in restaurant Inspection, not 
selling food or putting out fires. The Importance of these pieces of 
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information seeis less iaporcant than the facts that only 57% of all 
9-y«ar-ol(l8 know a'ccuc town mayors and only 35Z know about riftaurant 
inspection. Even these results seem explainable within the non>al world 
of 9-year-oW8. 

By age 13» Males and Females seem quite similar as shown in Figure 
13. In fact, however* at least on some items, they are more different 
than at age 9. The Males outpoint the Females froK 6 to 7 percentage 
points on questions relating to national and international governmental 
structures, e.g., what the United Nations does and how a presidential 
candidate is nominated in the United States. But even with their super- 
ior performance in the latter case, only ene out of five of the boys knows 
about national political conventions. 

By age 17, a pattern which looked possible at age 13 seems more 
established. The depoliticization of Females is in full progress by 
age 17. While the differences between Males and Females on individual 
questions are not great — about half the significant differences are 
between 5 and 10 percentage points — they are significantly different 
on 14 exercises. On 13 of these the Males are above the National per- 
centages while the Females are below. The greatest Male advantages are 
on exercises referring to such matter^l'as the nomination of presidential 
candidates and the declaring of congressional acts unconstitutional. The 
only significant Female advantage is posted in a set of exercises requir- 
ing the interpretation of a replica ballot, as follows (National p<)rcen- 
tages of success and Female and Male Delta P values are indicated in par- 
entheses). 



"The ballot below was used in a seneral 
election* Look at the ballot to answer 
the questions on this and the following 
two pages. 





LEGISLATIVE 




COUNTY 


OFFICES 


SENATOR 
IN CONGRESS 
(vote for one) 


REPRESENTATIVE 

^ IN CONGRESS 
(vote for one) 


COUNCILMAN 
(vote for two) 


TAX ASSESSOR 
(vote for one) 


DEMOCRATIC 


Alan F 
KIRK 


John G 
SMITH 


4artha G 
DAVIS 


Peter V 
MOSS 




REPUBLICAN 


James M 
JONES 


Mary 
0* CONNOR 


John 
RICHARDS 


Michael M 
MERWIN 


Joseph L 
LASKI 



A. If you wanted to vote for Kirk for senator, 
could you also vote far O'Connor for member of the 
House of Representatives? 



(National X 72.8) Yes 
(F -1.34> M 1.41) No 

I don*t Know. 

B. Could you vote for both Davis and Moss for 
councilman? 



(National % 83.2) Yes 
(3f 2.11? M -2.23) No 

I don't know 



ciuncJil'nr '''''' "^^^i'^ 

(National Z 73.6) 

<f .351 M -.37) No 

I don*t know 
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C. If you were registered as a member of the 
Democratic Party, could you vote for Laski for 
tax assessor? 

(National X 62.6) V)bs 
< F -2.78| M 2.93) No 

I don*t know 



E. Could you vote for both Kirk and Jones for 
senator? 

(National X 90.1) Yes 
(F .29; M -.31) No 

X don't know." 



Even in this set of questions where l^yearn>ld Females scored 
their only significant advantage (part B), they suffer two disadvantages, 
one of which is significant (part 0). On part D, which received the 
lowest National percentage of any part, tht answer cannot be deciphered 
solely fron information on the ballot. Other Infomatlon about general 
elections must also be known. Perhaps Females are a bit better In 
figuring out the ballot puzzles, but are less Informed on election rules. 

At the Adult level, the differentiation of Males and Females on the 
criterion of this Structure color scheme is complete. The Male Adults 
are above the National percentage on every one of the 21 exercises In- 
cluded} the Female Adults are below on all. All but 3 Delta P values out 
of the 42 registered for the two groups are significant, Ihe lowest 
advantage scored for Males is 2.62j the greatest is 19. 2Z. 

Itae Males and Females are most nearly alike in their responses to the 
voting exercises cited above and on two questions about the federal govern* 
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ment. One of these la unreleasedi the other asks which levfcl of govern- 
nent could raise nail rates. They are most different on four detail 
questions about the federal government. TWo of these are unreleased. The 
others ask which branch of government can declare a Congressional act un- 
constitutional and how a presidential, candidate is ncninated. 

These results nay suggest that the school and the society cooperate 
in the depoliticization of Females in this country. As they grow older. 
Males display an increasing advantage over Females on knowledge about 
political matters and political structures. 

Rights and Dutiea. Figure IS and Table 15 depict Male and Female 
median Delta P values for the color scheme on Rights and Duties across 
three age levels of 13, 17, and Adult. Age 9, as we have said before, 
has only one exercise in this theme and, therefore, is not included here. 

Table 5 



Knowledge of Institutional Rights and Outvies - Sex 
Social Studies 1971-1972 
„ ^ Median Delta P 

Category. . Aee 9 Ap. i^ 


Adult 


National Med. Z 7^^^ 


80.6 


81.3 


-0.6 


0.2 


1.7 


female 0.5 


-0.3 


-1.8 



The median Delta P values shown in l^ble IS and Figure 15 for 
age 13 suggest that Males and Females are much alike on the ten exercises 
summarized. A review of the Delta P values for individual exercises 
seems to confirm this judgment. The Females have seven of ten exercises 
above the National percent of success, but none more than 2.U above. 



Median 

Delta P 



AGE,, 
NINE 



THIRTEEN 



SEVENTEEN 



ADULT 



X 



10 - 

9 - 

8 « 

7 - 

6 - 

5 - 

A - 

3 - 

2 - 

I - 

. . . .0. 

BELOW . 
X ^ 

-2 - 

-3 - 

-A - 

-5 - 

•6 - 

-7 - 

••8 *" 

«9 •> 

-10 - 

-11 - 

-12 - 

-13 - 

-U - 

-15 - 

-16 - 

-17 - 

-18 - 

-19 - 

•20 - 
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Since all Male/Female distributions in these data are inversions^ the 
Males necessarily have seven exercises below the National percentages 
but none more than -2.0Z. The two greatest Female advantages are on two 
unreleased exercises about freedom of speech and religion and due process* 
At the other end of the distribution^ the Males register a 6,2% advantage 
on an exercise which asks» 

"Should a newspaper or magazine be 
allowed to publish something that 
criticizes an elected government 
official? 

Yes 
No 

Undecided." 



At age 17 the median positions of the two groups are reversed 
with Males being slightly above Females. The dispersions are greater 
at age 17, however. Female advantages on five exercises in which the 
two groups are significantly different range between 3.33; and 9.5%. 
The Females are significantly more successful on exercises referring 
to race as a factor in employment and freedom to criticize military 
actions a«d en a txro part exercise which asks* 

* This inversion phenomenon is easily explained given the fact that 
the Male and Female samples are roughly equal in number in all groupings 
and« of course* given the necessary inclusion of everyone assessed In one 
or the other of the halves. Thus, the National percentage of success on 
individual exercise would lie midway between the Males* percentage of 
Sttceesi and the Females* percentage of suoeeis. When converted to Delta 
f values » a Male * value vould be matched by «tt equal Female •> value or 

IhS*i!!SS!l««^?*-f!£** * I*^"*' » ^^«^ distribution, 

tms inversion of scores and exercises occurs. A similar i*Ai*«t4AM«h4n 4. 

ss^sL' .^u."" ••^"'""tirrtii th. ««s.M'i!jssrj*i» 

SveSSe*!^ pre»«iee of th. Otiwr etttgory aak. th« inrariimi 
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••A. Should a congressman pay attention 
to the opinions and concerns of people 
whose views are different from those of 
the majority? 

Ves 
No 

Undecided 

B. Please explain any answer you sel- 
ected. 

Qihritten answers Judged acceptable or 
unacceptable • *• 

Males, on the other hand, did significantly better on exercises 
referring to the right to picket to show dissent, athiests holding office, 
and newspapers criticizing public officials. 

While the difference in median Delta P values between Adult 
Males and Females is only about 3.5%, the variance on individual ex- 
ercises is considerably greater than for either 13 or 17-year-olds. 
For example. Males scored a 15.3% advantage over Females on the question 
whether persons who do not believe in God should be allowed to hold 
public office. Fewer than half the women sampled are willing to have 
an atheistic public official. The Males also have about a 12% ad- 
vantage over Females on questions whether persons should be allowed to 
picket in protests against rock festivals and alleged police brutality. 
Over half the women (57%) would allow the picketing of rock festivals, 
but fewer than half (46%) would allow the picketing of police stations. 
While 2/3 of the man would allow picketing against the festival, only 
a slight majority would permit picketing against reported police bru- 
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tallty. Most Adults (77,5%) believe that persons should be allowed to 
assemble In a public place to make demands known. Males, however, are 
lOX more likely to support such actions. 

Females, on the other hand, post some advantages over Males. They 
have about 6.7Z advantage over the men on a question about due process 
in a given situation and are slightly more likely than men to reject 
race as a factor in employment. Differences this snail could, of course, 
be due to chance. 

It would seem on the whole that Males display a greater knowledge of 
or greater comnitment to democratic rights and duties than Females. This 
Male advantage emerges between ages 13 and 17 and increases through youag 
adulthood. One is tempted to conclude that Females are socialized in this 
society to be less Interested in, to know less about, and possibly to bt 
less cooaitted to certain political values than Males. This conclusion 
seems consistent with common observation. The politicized Female still 
is an anomoly is this society. Schooling likely contributes to the dep- 
olitioization process. Schools, however, are only one factor. 

Race 

Figures 16 and 17 and Tables 16 and 17 display the results of these 
Institutional exercises subdivided into Structures and Rights and Duties 
color schemes and analyzed by Black and White races. A third category of 
persons classified as Other, i.e., presumably neither Black nor White, is 
excluded from this analysis because of the few numbers of persons in the 
category and some inconsistencies in the identification of Its members. 



Structures. Figure 16 and Table 16 display the median Delta P values 



1 
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for the two racial groups across the four age samples for the exercises 
classified as Structure. 

Table 16 

Institutional Structures - Race 
Social Studies 1_ 971-1972 
Hedian Delta P 

Categpyy AgeJ Age 13 Age 17 Adult 

National Med. : 73.8 53.7 72.7 74.4 

Black -12.5 -12.5 -16.0 -20.5 

"^ite 2.8 1.8 3.0 3.5 

The variance between Blacks as a group and Whites as a group on 
Structure related questions is apparent in Figure 16. The median Delta 
P values are between 15 and 24 percentage points apart. While half of ^ 
the individual exercise results are closer together than these medians* 
no individual exercise result for the two groups is closer than 6.621 at 
age 9, 2.8Z at age 17> and 10,3X at the Adult level. Only at age 13 
does the Black group score higher than the White group on individual 
exercises* There the Blacks have advantages on two exercises of 2.9% and 
8.5X. At their greatest differences on individual exercises Whites score 
advantages of 22% at age 9, 33% at age 13> 30% s^t age 17> and 39% at the 
Adult level. 

As in the previous displays of the overall results from all exercises 
in Tables I, 2* and 3 and Figures I, 2, and 3» the confirmed picture is 
that of two groups significantly and dramatically differentiated by their 
performances on these NAEP exercises. 

At age 9, the two groups approach each other the e^sest on a question 
which askst 
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"In a court, which one of the follow- 
ing has the job of making sure that the 
trial is fair and run according to the 
rules? 

The judge 
The lawyer 
The jury 

The person on trial 
I don't know." 

Nearly 3/A of all ^year-olds could answer that question corr- 
ectly. Whites are only 1.6% above the National percentage while Blacks are 
only -SiOZ below. Black and White 9-year-olds come nearer equally 
sharing this information than any other in this color scheme. At the 
other extreme, only 1/3 of all 9-year-olds know that health depart- 
ments inspect restaurants, when divided by race, about M of the White 
children answered the question correctly, while only 17.6% of the 
Black children know this fact. 

Explanations for such results tumble out rapidly. As a group, 
9-year-olds are not especially aware of the ordinarily unsung govern- 
mental f unctioh of restamrant inspection. Just as likely, they are not 
sensitized to cullinary cleanliness or possibly to restaurants them- 
selves. Beyond this. Black youngsters probably frequent restaurants 
less than White youngsters. 

On the other hand, Blacks frequent court rooms as trial princi- 
pals in this country far beyond what their population proportion would 
predict. Furthermore, television dramas offer recurrent though usually 
distorted views of court room scenes in which judges mainly play re- 
ferees between wily lawyers. 

In another instance, .wer 60Z of the White 9-year-olds could 
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Identify the mayor as the head of a town government, while only A5% of the 
Black 9-year-old« could do so. Cultural explanations of this 15X variance 
are harder to come byj but one possibility Is that Blacks In this country 
tend to be either city or farm folk. Towns are predominantly white. Thus, 
probably a smaller proportion of Black than White 9-year-olds In the 
sample would be town residents. However, we do not have that kind of In- 
formation on the composition of these samples. 

At age 13, the Structure color scheme is assessed by means of 16 
exercises. The range of successes over these exercises for White 13-year- 
olds goes from -1.02 below the National percentage to A.5X abovei the range 
for Black 13-year-old8 goes from -29.0Z below the National percentage to 
7.5% above. 

On one unreleased exercise for age 13 concerning a function of a 
major department of the federal executive. Black 13-year-olds achieved an 
advantage of 8.52 over the Whites. It Is also the exercise on which Black 
17-year-olds did best while White 17-year-old8 did very poorly. In both 
cases, since the Whites, who outnumber the Blacks In the samples by 6 and 
6.5 to 1, did badly, the National percentages of success are quite low. 
Only 27X of all 13-year-olds and 382 of all 17-year-olds answered the ex- 
ercise correctly. The rfcsult may have very little meaning, actually, since 
the National percentage is at the chance level of performance at the 13- 
year-old level. 

On three related questions about government services. Black and White 
13-year-old8 are extremely divergent in their successes. Students, were 
asked "Which level of government (federal, state, or local) would be most 
likely to pass" the following! 
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. . an act to raise the rates for sending 
letters through the mail? 

. * . an act to lower taxes on goods coming 
into the country? 

... an act to increase garbage collection services?" 

The National percentages on the three questions are 71.73;, 73. and 
77. OZ. The White 13-year-olds are above the N^itlonal percentage in each 
case by 3.6t to A.SZj but the Blacks register deficits from -21.0% to 
-23. 9Z. A bare majority of Black 13-year-olds could answer the questions 
correctly, while over 3/4 of the Whites responded correctly. 

A whole set of cultural effects Is probably operating here. It 
would seem gratuitous to point them out. Whether they are sufficient 
to explain the 25% disadvantage of Blacks Is, of course, the central 
problem. 

We will mention one other exercise which Is the locus of poor 
performances of all the samples in the assessment. Age 13 respondents 
scored their lowest National percentage of success on this exercise. 
They were asked, 

"The presidential candidate for each 
major political party is formally 
nominated by which one of the following? 

The Senate 

A national primary 

A national convention 

The House of Representatives." 

Only 17.0% of the 13-year-olds could answer the question corr- 
ectly. Whites managed to make that 17.9%; Blacks scored a bare 10.8%. 
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PresldentlaX campaigns seem not to be a major interest of American X3- 
year-old students » Black or White. 

At age 17 the median advantage of Whites over Blacks increases to 
192, This difference reflects a range of differences on individual ques- 
tions from as little as 2.9Z to as great as 32.1%. All of these differ- 
ences in Delta P values are White 17-year-old advantages over Black 17- 
year-olds. Thus, on all but one exercise Whites scored significantly 
above the National percentages, on all exercises Black 17-year-olds scored 
below the National percentages, and all but one are significantly btlow. 
The Black and White 17-year-olds responded alike, i,e., neither is signi- 
ficantly different than the National percentage for all 17-year-olds, on 
an unreleaiied exercise about the functions of a department in the federal 
executive. Albeit, that result is by far their lowest National percen- 
tage of success; only 37,7% of all 17-year-old8 narked It right. 

Black and White 17-year-olds are most different In their responses 
to two questions about the federal government and one question about a 
function of local governments. On the two of these that are unreleased, 
one of the federal governmwit questions and the local govemaent question* 
53X and 88Z of the White 17-year-olds marked them correctly while only 28Z 
and 57Z of the Black 17-year-olds did so. The released federal question 
asks how a presidential candidate is nominated. While barely a majority 
of Whites could answer this question, only one in five of the Blacks marked It 
correctly, less than could be expected on the basis of guessing. 

Among Adults the differences between Blacks and Whites widen still 
further. While there Is a general gain In Adult National percentages of 
success as well as In all Adult Raw P values for both Flacks and Wliltes 
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over comparable values for 17«year-olds on these Structure questions, 
all of which are shared by Adults and n-yoar-olds, the Blacks tend to 
gain fewer percentage points and less consistently than Whites. All 
Vhite Adult Delta P values are significantly above the National percentages and 
all Black Adult Delta P values are significantly below the National percenUges. 
Within their ranges of typicality, Black and White scores on indivi- 
dual questions vary from 19 to 30 percentage points^always with a White 
advantage. Where they approach each other in performance, i.e., on an item where 
Blacks do their atypically best and Whites their atypicaliy worst, the 
Whites post only a 10. advantage. This unreleased exercise has to do 
with the armed forces. At the other end of the scale, on the question 
about national political conventions. Whites have a 39. 2X advantage. 
Only 26, 2X of the Black Adults could answer the question, a guessing 
score. Nearly 2/3 of the White Adul^know that presidential candidates 
are nominated by national conventions. 

Three of the four questions which are the loci of atypical per- 
formances by both Blacks and Whites are also among the five easiest questions 
fot Adults. The National percentage for each of the five exercises is above 
90Z. On one of these, the baUot question where respondents are asked if 
they could vote for both Democrat Kirk and Republican Jones for the single 
Senate seat, 802 of the Blacks and 92t of the Whites could answer correctly. 
On another, 97% of the Whites and 82Z of the Blacks noted that the federal 
government could raise mall rates. 

On two other questions. Blacks do comparlslvely less well. Only 715; 
of the Black Adults as compared to 95Z of White Adults could relate the 
federal government with the control of tarrlf rates. At the local level. 
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only 2/3 of the Black Adults connect garbage collection with local govern- 
nent} 9SZ of the White Adulta know this common local govemnent function. 

While there is improvenent in the performances of both Blacks and 
Whites from the lower to the higher age samples on the shared questions » 
it seems undeniable that the relative disadvantage of the Black samples 
increases with increasing age. Schooling may contribute to the ability of 
all persons to respond to questions such as these j but it is not effective 
in reducing the performance gap between these two racial groups in our 
country. That such a gap can be described racially is evidenced in this 
NAEF assAssnent and in most other evaluative efforts that enjoy mainstream 
fsauctlonet. That such gaps become defined racially Is the unfortunate and 
unwarranted conjiequence. 



Rights and ftitles. Figure 17 and Table 17 display the group 
effects of the three Black and White age groups for which there are 
exercises classified as measuring a mix of knowledge of and commitment 



to some Rights and Duties associated with some 


of our social insti- 


tut ions. 


Table 17 




Knowledge of Institutional Rights and Dutiee - Race 

^^^^^?iei«iirr^^2 

Category 9 A«e 13 a«.o 17 am»i. 


Natiional Med. X 


76.6 


80.6 81.3 


Black 


-9.9 


-7.0 -15.5 


White 


1.9 


1.5 2.4 
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The relative advantage of White respondents over Black respondents 
ranges from 8.5% at age 17 to 17. 9X at the Adult level. The apparent gain 
In Black performances noted at age 17 on this set of exercises is also re- 
flected in the Southeast group on the regional displays and in the Low 
Metro group in the STOC exhibits. The southeast and the inner city are 
likely locales of the majority of Black respondents in these samples. 

Within their ranges of typicality. Black and White 13-year-olds 
differ from each other from 7,2% to 17. on indJ.vidual exercises. 
Within this group of question.'; to which both groups responded typically 
is the question, 

••Should race be a factor in 
hirinfi someone for a job? 

Yes 
No 

I don't know.'^ 

"No** is the response of 90,5% of the White 13-year-olds and the res- 
ponse of 83,3% of the Black 13-year-old8. 

The two groups are actually closer together and unexpectedly 
more settled on a question that asks, 

••Do you think there should be 
laws against acts of vandalism 
such as destroying a statue? 

Yes 
No 

Undecided. •• 

Nearly 95% of the Blacks and 93% of the Whites approve of such laws. 
This is the only question on which Blacks 13"year"'olds post an advan- ' 

ER?C 
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tage over Whites. A contrast in performance and in content is found in 
an unreleased exercise referring to religious freedom. While 81% of the 
Whites supported this value, only a bare majority of Blacks did. To 
suggest that the responses to the two questions, especially among Blacks, 
demonstrate a disparity between human and property values is probably too 
facile. 

At age 17, the Rights and Duties color scheme is defined by 21 
exercises. Nine questions are shared with the 13-year-old group and all 
but one are shared with the Adult group. As in all other distributions 
featuring Black and White respondents, the dispersion of the Whites* Delta 
P values is quite compact, running from -1.5Z to 4.8% for a total range 
of only 6.3 percentage points, while the dispersion of Blacks* Delta P 
values is broad, running from -24.5% to 7.6% for a total range of 32.1 
percentage points. 

The two groups are practically alike in their responses to the 
question involving racial discrimination in employment and an unreleased 
question on age discrimination. On the racial (discrimination exercise, the 
two groups* performances are within 0.8%i on the age discrimination ques- 
tion only 1.4 percentage points separate the two groups* results. The 
National percentages for the questions are 93.8% and 89.3%. 

Black and White 17-year-olds are most different on a question 
involving the freedoms of speech and religion and a question which 
asks, 

"Should a person who does not believe 
in God be allowed to hold a public 
office? 

Yes 
No 

Undecided." 
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The groups' responses vary 21.2% on the first and 29.2% on the second. 

About 60/5 of the Black ly-yeat^-olds appear to be supportive of religious 
and press freedoms in the firsts but only about 38% are supportive of 
rellBlone freedom in the second as compared to 82% and 67% of the White 
17- year" olds. 

Also among the most varied responses are those related to the 
quest lon« 

"Do you think people should be allowed 
to picket the holding of a rock fes- 
tival as a protest against It? 

Yes 
No 

Undecided 

No response. " 

A small majority of 52.7% of all 17-year-olds would support this sort 
of action. As a group, Whites are slightly more willing; 56.5% would 
approve. However, among Black 17-year-olds, only 32.8% are approving. 
The contrast between Blacks and Whites is complicated by the fact that 
just half the White 17-year-olds are approving of the picketing of a 
police station to protest reported police brutality; but 59.2% of the 
Blacks vould approve. Roughly speaking, almost twice as many Black 
17-year-oXds wottld allow a picket protest against alleged police bru- 
tality as would allow a picket protest against a rock festival* The 
effect of social experience on the way persons respond to presumably 
similar situations* picketing. In this casfi. seems well deaonstrated. 
Perhaps, the effect of social experience on the way persons respond to 
NAEP test questions is better demonstrated* 
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Adult Black and Whit.<9 respondents demonstrate the same patterns on 
Rights and Duties exercises as do the IS-year-old and 17"year«old 
samples* All but two Delta P values of Whites are above the National 
percentages and all but two Delta P values of Blacks are below the National 
percentages. The median Delta P values in Table 17 and Figure 17 suggest 
further that on Rights and Duties exercises* as was also noted earlier for 
the Structure exercises* Black and White Adults differ more from each 
other than do either the 13- or 17**year'-o1.d Blacks and Whites* 

On three exercises in this color scheme* Black and White Adults are 
most alike* i*e.* neither group is significantly different than the 
National percentages of success* It is on these exercises that the 
Whites produce their lowest Delta P values and the Blacks produce their 
highest* The two released questions refer to the factor of race in 
employment and picketing a police station* Over 90Z of both groups be- 
lieve race should not be a factor in employment and just over 50% of each 
group believe that persons should be allowed to picket against brutality* 
The radicals among the Adults are those persons classified as Other who 
are not included in this report* They posted an impressive advantage of 
16* 9Z on the police picketing exercise* 

The Adult groups are most different on three released exercises where 
the Whites are from 3*7Z to 5»0X above the National percentages and the 
Blacks are from 20* to 29*9% below* The three exercises* previously re- 
ferred to in other sections of this report* concern athiests holding public 
office* picketing a rock festival* and the Supreme Court decision on re"* 
ligion in public schools* The National percentages on these questions are 
55*62* 63%* and 52*3%* The principles involved in these questions are 
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either not too well known or are not too well regarded by this aanple 
of Adults or are opposed by other values unknown. 

According to these results, the principles are also not equally 
known or regarded by these BUck and White Adults. In the following 
exercise, 57. 4Z of the White Adults sampled recognize the principle of 
separation of church and state; but only 22AX of the saopled BUck Adults 
know the grounds for the fanous decision. 



"The Supreme Court ruled that It is 
unconstitutional to require prayer 
and formal religious instruction In 
public schools. 

Which one of the following was the 
basis for l^s decision? 



The requirements violated the right 
to freedom of speech. 

There was strong pressure put on the 
Supreme Court by certain religious 
minorities. 

Religious exercises violated the principles 
of the separation of church and state. 

Every moment of the valuable school time 
was needed to prepare students to earn 
a living. 

I don't know." 

"I don't know" presumably functions differently than a substantive dls- 
tracter in such a question; however, given the right assumptions about the 
four dlstracters In the exercise, guessing by the entire Black Adult p >pula- 
tlon In this sample could be expected to yield the same result they produced. 
Neither do the Whites earn accolades for their performance. Chtpli^»s team. 
In another Inquiry Into this assessment, estlauited that at least BOX and 
possibly aore than 80« of the Adults should be able to answer this question. 



ERIC 
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Btsides the chance results of guessing* conjectures as to why these 
Adults perfonwd so poorly here are myriad. They would have to inolude* 
It would seen* the possibility tliat these Adults* in the absence of recall 
knowledge about the ease* respond more readily to suggestions of political 
practicality than to moral principle and* therefore* project the sane 
posture to others* Including Supreme Court justices. It Is far more pra- 
tlcal to suppose that the Court yielded to pressure — not a bad guess* 
really* given the political nature of that Institution. 

In another of these differentiating exercises* about 602 of the 
White Adults appear willing for a person who does not believe In God to 
hold public office. That majority Is not likely to get an athleat elected 
in many coimunities* however* tJt only about 3SZ of the Black Adults are 
so inclined. The anonoly Is that Blacks* who have been extraordinarily 
influential In expanding civil rights relative to race* appear not to extend 
these principles to other realms such as religious belief. 

The last of these exercises also suggests some contrasts. Some 
67% of the White Adults would allow pickets to protest a rock festival. 
Only 39X of the Black Adults would do so. Tlie contrast between the groups 
anent rock festivals, which may reflect different musical tastes. Is 
less telling than the contrast with these groups* previously cited wlll- 
Ingdiess to picket against reported police brutality. Just over half of 
both grouK; (#ould allow anti police pickets. Thus, to draw the lines of 
perspective a the Blacks are more willing to allow active protesting of 
police brutality than they are to allow active protesuing pt rock festivals. 
Whites* on the other hand* seem more concerned about the festivals than 
about the brutiilty, Perhaps the difference hat soMthlng to do vlth whose 
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ox is gored. 



Parents* fir^ unation 



In this section, the results for the four age levels in the two 
color schemes are analyzed across four levels of parents' education. The 
median Delta P values used to characterize the different groups are 
shown in Tables 18 aOd 19 and Figures 18 and 19. 

Structures. T^ble 18 and Figure 18 display the result. In the structuwis 



Table 18 

noirledge of Institutional Structure - ?^!i:«ntf • Education 
Social Studies 1971-1972 
Nedltn Delta P 



0 tegorv 


Age 9 


Age 13 


- Age 17 


Adult 


National Med, X 


73.8 


53.7 


72.7 


74.4 


No HS 


-8.6 


-8.3 


-13.3 


-9.4 


Some HS 


-7.9 


-6.2 


-8.2 


-2.6 


HS Grad 


2.7 


-0.6 


-0.1 


3.3 


Post HS 


4.4 


5.5 


5.9 


9.1 



the., for ages 9, 13, 17, and Adult classified according to whether 
neither of the parents of the respondents went to school beyond the el*th 
gttde. «t least one parent started but did net finish high school, at 
le..t one parent graduated fro. high school hut did not go beyond that, or' 
.t least one went on for ,m> kind of training ,ft«^ graduating fr«, high 
.chool. ihe two exhibits atte.pt to show the reUtive rel.tion.hlp, be- 
tween the respondent., answer, to these questions and the v.rt«. educational 
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exposures of their parents. 

The displays strongly suggest that the four age saaples can be 
divided into discrete populations according to the different levels of 
parents* education. The relative positions of the median Delta P values 
are heirarchical and consistent. The higher the educational attainment 
of the parents » the better the respondents perform on the set of questions 
classified by this theme for each age level. 

At age 9, the sample is almost dichotonous with the No High School 
and Some High School groups producing all results on individual questions 
below the National percentages i eight of the two groups* ten Delta P 
values are significantly below. In contrast, all of the ten Delta P values 
of the High School Graduate and Post High School groups are above the 
National percentages} eight are significantly above. 

The four age groups come nearest performing as similar populations 
on the question which asks who is responsible for a fair trial. Only the 
Post High School group answered this ijuestlon at a level that it signifi- 
cantly above the National percentage of 73. 8Z. The Post High School success 
of 77.6Z has an advantage of 10.72 over the lowest No High School group. 

Ihe Post High School group's advantage over the No High School group 
Is 18.0X on the'town mayor* question and 16. 5Z on the 'restaurant inspection' 
question. In both of these questions the Post High School group is signifi- 
cantly above the National percentages while the No High School group is sig- 
nificantly below. Only M of the No High School group know that the mayor 
is the head of a town government and only 27.22 know that health depart- 
ments inspect restaurants. Few 9-year-olds in any category know this health 
information. Only M of the Post High School group marked the question 
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Median 

Delta P 

10 
9 

a 

7 
6 
5 
A 
3 
2 
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AG£., 
NINE 



THIRTEEN 



SEVENTEEN 



ADULT 

POST HS 




-1 

-2 

-3 
-A 
-5 
-6 
-7 
-8 
•9 
-10 
-11 
-12 
-13 
-lA 
-15 
-16 
-17 
-18 
-19 
-20 



HS GRAD 




- NATIONAL 



SOME HS 



NO HS 



Figure 18 
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correctly* 

The dichotomy between the Post and High School Grad groups and the 
Some and No High School groups observed at the 9*7ear'-old level seems not 
to hold at age 13. For one thing* though not detectable in the median 
values shown in Table 18 and Figure 18» three of the groups' scores are 
far more disperse at age 13 than at age 9. At age 9, the spreads of the 
four age categories on five observations are 5,?X, B,6Z, 4.12» and 
At age 13^ the spreads on 16 obstirvations are 26.5Z» 15.1Z> 4.2Z> and 13.4Z. 
The anomoly is the High School Grad group with a dispersion of only about 
A.OZ in both age samples. There seems no self evident explanation for the 
anomoly. The High School Grad group simply performed close to the National 
percentages on all the exercises. The Some and No High School groups hover 
near the National percentages on perhaps 1/3 of the exercises » but plunge 
16% to 24Z below on others — ' though not necessarily on the same ones. 
Meanwhile^ the Post High School group soars above the National percentages 
from 2«4Z to 13. IZ on all but one exercise. 

The groups performed alike only when everyone appears to have been 
guessing. For example^ an unreleased exercise asks for the identification 
of a federal executive department by Its major function. All scores non- 
verge to the National "guessing" percentage of 26. 7Z. 

The greatest differences In the groups ace registered for the two 
exercises which ask for the Identification of the levvil of government. I.e., 
federal* stata» or local* most likely Involved In lowering taxes on incoming 
goods and in increasing garbage collection. The Post High School group 
earned Its greatest advantages on these questions with successes of 13.1^ 
and 11. OZ above the National percentages while the No High School group, In 
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contrast, suffered its greatest disadvantages with successes of -16.6% 
and -23.7%. The High School Grad group, which deviates from the National 
percentage but little on any question, has a Delta P value of -3.152 on one 
and -2.351 on the other. The Some High School group has one of its worst 
scores on one, -11.93;, and one of its best on the other, -1,3X. 

Generalizations at the 13-year-old level, other than those suggested 
above, are elusive. While overall, the 13-year-olds, do not perform well 
on this set of questions, in general they do somewhat better on exercises 
whose contents have recurrent reinforcement in day to day experience. For 
example, practically none know how a presidential candidate is nominated 
<17J; for all; from 12Z to 202 by group); but most Know how men get into 
the armed forces in wartime (82% for allj from 702 to 902 by group). 
There are results, however, which make this generalization less than firm. 
For example, more No High School respondents know that a senator usually is 
elected rather than appointed (702) than know that local governments collect 
garbage (522). 

At age 17, the groups appear to perform much as they do at age 13. 
All Post High School 17-year-old3» Delta P values are above the National 
percentages and all but one are significant! all No High School Delta P 
values are below the National percentages and all but one are significantly 
below. The Some High School 17-year-olds look\ bit like a replica of the No 
High School group, but with Delta P values elevated about S percentage 
points. Nonetheless, all but one of these values are below the National 
percentages; all those below are significant. The 52 difference is accur- 
ately r^iflected in the median Delta P values in Table 18 and Figure 18. The 
Post High School 17-year-olds are something of a reversed image of the Some 



and No High School groups with their beat relative perforaancea on exer- 
olaea on which the other groupa performed most poorly. The dlaperalona of 
these three distributions are also quite large. The No, Some, and Post 
High School groups* spreada, la that order, are 20.7%, 22.6%, and 11. SZ. 
The High School Grad group maintains Its anomolous character. Its Delia 
P values are all within abcut ♦-aX of the National percentages, half above 
and half below. The list of 21 exercises, ordered from the group's best 
to poorest performances, does not resemble the lists of the other groups 
when ordered by the same rubric. An acceptable explanation Is no more 
apparent for the 17-year-old8 than for the 13-year-olds. 

One explanation, which lies somewhere between a pure c lecture and 
a random guess. Is that the group whose parents graduated from high school 
but never went beyond high school has the strongest orientation to school. 
It becomes the normlng group on these exercises which also reflect a 
strong taint of schooling. The other groups, those whose parents were 
less or more successful In school, deviate In different ways from the norm. 

There seems to be some evidence for this hypothesis. The best ex- 
ample of It relates to the exercise on the nomination of presidential candi- 
dates by national political conventions. Th-a National percentage for this 
question for all 17-year-olds Is 48. 5Z. The High School Grad group attained 
48.62 on this question. Both the Some and No High School groups turned In 
their worst performances on this question with Delta P values of -18. 8Z and 
-22.62 respectively while the Post High School group turned in its best per- 
formance with a Delta P value of 12.12. 

In another Instance on an unreleased exercise concerning school gov- 
ernance, the High School Qrad group Is about 1.02 below the National per- 
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eentage and within 0,9Z of its own median Delta P value for all of these 
exercises while the No and Sone High School groups produced their best 
Delta P values of -1,9Z and respectively and the Post High School 
group produced its worst Delta P value of 0.7Z, 

At the Adult level, differences in the groups continue to manifest 
themselves. Inequalities in performance in this assessment associated 
with different family environments with respect to parents* education are 
not erased by time. Having been reared by parents who did not attend high 
school appears to disadvantage Adults with respect to this assessment, in 
much the same manner that it appears to disadvantage others of similar 
backgrounds of school age. Furthermore, while there is tome reason to 
infer from the«a data that there is a slight improvement in test perform- 
ances of this kind by persons after 17 years of age, there is more basis 
for inferring that the important gains are made during the school ages of 
13 and 17. These inferences can be made largely from the median National 
Raw P values shown in Figures I, 2, and 3 in the early part of this report. 
The evidence here relative to Structure information suggests that among 
groups all such improvements are parallel. No group - here, for example, 
groups categorized by parents* education — escapes its past. 

An example of the kind of improvement referred to is in the question 
about a presidential candidate*s nomination. Less than half of all 17- 
year-olds could answer this question? but nearly 602 of all Adults know 
this function of national conventions. That would count as improvement if 
it is more than a chance gain. The persistent inequalities are shown by 
the fact that as Adults, still less than half (442) of the persons whose 
parents never went beyond eighth grade know how presidents are nominated. 



About SIX Of th. So«e High School group kno» this fact .long with about 
M Of the High Sch«>l Orad group. In contrast, m of tho group who.e 
P.r«nt. wont on to achool after high school aarked the question right. 

- Stmt things, it seem, nearly all Adults know. That the federal 
govern»eat carries the mil Is known by 95X of all Adults. Even here. 
•«~.ver, group difference, persist. The No High School group post, a 
high n.3Z on thi. question, but the Post High School group hits a 
cracking 99. 2X, 

A phenonenon of these Adult data when categorized by parents' educa- 
tion 1. the uncannily accurate ord«ring of the exorcise, by difficulty in 
the Post High School distribution. That Is, on the hardest exercises, 
those Which received the lowest Hitlonal percentage, of succe.., the Poet 
High School group achieved It. highest Delta P scores. But on the easiest 
question. wb«r. the national percentage, of succ... were hlgheet. the Po.t 
High School group achieved It. lowest Delta P values. 

One's first l^Msslon Is that thl, group did best on the bard 
questions and poorest on the easy questions, but that Is not the case, for 
on the easiest question of all for the Adults as a whole, the Post High 
School group has a percentage of success of 99, 3X. Ihat »ean. only three 
person, m the whole p,«,„Utlon ».l..ed the que.tion. The fact i. that 
the Poet High School group did well on all th. questions, When the National 
perc«.t.8. was high, there was slaply ie.s r««e on top for the Post High 
School group's advantage. 

A second hypothesis is hazarded. The «»t eon.i.t.nt, effective, and 
long lasting Influence on the ability to respond to question, of this kind 
t. th. educational environment of the h«.e. Anoth,r way to put it is that 
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parents who are successful in school have children who are successful in 
school. That assumes » of course* that the ability to answer these ques- 
tions is related to or is aore generally expressed as the ability to succeed 
in school. Persons who are successful in school work are successful 
partially, at least, because they develop interests in the things 
schools stand for and emphasize. To some extent, perhaps to a great 
extent, such school reUted interests are retained into adult life and 
are perpetuated as interests in the lives of children, 'Visiting," as 
it were, "the iniquity of the fathers upon the children to the third 
and the fourth generation 



Riffhts and Duties. Table 19 and Figure 19 exhibit the median 
Delta P values for three age levels for the exercises in the Rights and 
Duties theme as categorized by parents* education. Age 9 is not repre- 
sented because of too few exercises in this theme. 



Table 19 



Cateftory 


Social Studies 1971-1972 
Median Delta P 

Aise 9 Aee 13 


AKe 17 


Adult 


National Med. X 




76.6 


80.6 


HI, 3 


No High School 




-12.0 


-9.5 


-9.1 


Some High School 




-6.0 


-3.6 


-1.1 


High School Grad 




0.1 


-0.4 


2.4 


Post High School 




7.9 


4.2 


8.5 
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Iii gtneral tfirms» the rslatlonship of parents* education to percen- 
tages of sueeess in these theaatic arrays Is consistent with what was 
found in the Structure thematic distributions* Sorting on the four levels 
of parental education appears to result in four distinct populations which 
perfom consistently in this theme at all age levels. The Post High School 
group scores advantages consistently! the other groups consistently score 
relatively lower successes* 

As we have emphasized before in reviewing this theme» responses in 
this theme may carry a heavier value burden than those in the Structure 
theme. Knowledge of Structure questions are largely factual recall while 
the questions classified as Knowledge of Rights and Duties are an uncer- 
tain mix of fact and value. To some degree^ the Delta P values reported 
in this theme reflect a rating and ranking of preferences associated with 
our democratic institutions. In other espectSf they reflect a knowledge 
of the principles and rules by which our institutions are governed* To 
«ay» for example » that race should not be a factor in employment may in- 
dicate one*s preference in the matter or it may indicate a knowledge of 
the law of the land which explicitly prohibits racial discrimination in 
certain jobs and implicitly di'^courages it in most others » 

Among 13-year-old8» a distribution pattern similar to tl::at noted 
earlier for Structure is evident. Oist^^rsions of the No» Sone» and Post 
High School groups are fairly wide — 21» 1A» and 11 percentage points^ 
respectively — while the dispersion of the High School Grad group is 
narrow* only 5. 5 percentage points. Furthermore» all the No High School 
Delta F values are below the Natlotial percentages » as are all but one of 
the Some High School group's scores. In contrast* all Post High School 
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values are above the National percentages. The High School Grad group's 
Delta P values are half above and half below. 

On only one question did ail groups respond In the sane way? 93X of 
all groups, ♦-O.AZ, agree that there should be laws against vandalism. 
On all other exercises there is significant variance by one or more of 
the groups. No other question received so high a National percentage of 
success. A sense of property rights still appears to be alive and well, 
at least anong these 13«year-olds. 

At the opposite end of the success scale, only 48. 9Z of all 13-year- 
olds responded afflraatlvely to the following questloni 

"Should a newspaper or magazine be 
allowed to publish something that 
crltizes an elected government 
official? 

Yes 
No 

Undecided." 

This question also produced considerable variance among the groups. The 
Post High School group is 10. 5Z above the National level on the question 
while the High School Grad group. Its nearest competitor. Is -3.92 below. 
The Some and No High School groups are far below the National percentage 
at -14. 5Z and -13. IZ. While nine out of ten of the respondents whose 
parents either did not go or did not graduate from high school believe that 
vandals should be punished, only one out of three believe government offi- 
cials should be publicly criticized in the medl^. In addition, fewer than 
half of these groups would allow an athlest to hold a public office. On 
this question, over 60Z of the High School Grad group and 67Z of the Post 
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Hlgh School group would permit a person with such a belief to hold 
office* 

One Is tempted with such results to apply labels of liberal and 
conservative to the groups. However, conservative Is hardly the proper 
appellation for a group 2/3 of which would not allow newspapers to 
criticize the government; nor is liberal an especially appropriate way to 
refer to a group 1/3 of which would apply a religious criterion to 
public service. Th© application of a value conflict iiodel to these data 
would llktly surface a m^ber of both Inter- and intra -group oonfliccs 
that wirrant tont attention. 

No great liberal group shows up at age 17 either; though a tendency 
In that direction can be Inferred for the Post High School group on some 
questions. If certain assumptions are made about the meaning of liberal, 
the meaning of the questions, and the meaning of the responses to the 
questions. For example, the Post High School IT-year-olds have signi- 
ficantly positive responses of 4X to 10% above the National percentages on 
questions Involving public assembly, picketing police stations and rock 
festivals, criticizing government officials and policies, and athiests 
holding public office. Their advantage over the Some and No High School 
groups on these questions runs from 5Z to 30Z. If the assumptions can be 
made that a person supporting the activities listed above can properly be 
thought of as more liberal than a person not supporting them and that 
support or approval is what is being Indicated by the positive marking of 
those questions, then it follows that the Post High School group shows 
more of a tendency toward liberality than any other group. Admittedly, 
the conclusion Is tenuous. It would be just as valid to suppose that the 
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exercises measure an understanding of our way of life Inasmuch as all 
the activities referred to In the questions are In accord with the law of 
the land. That the 17Tear-olds achieve on these exercises National per- 
centages of success of only 502 to 90% nay more aptly suggest an Imperfect 
acquaintance with some elements of our democratic system. 

There Is evidence In two other sets of exercises In this theme which 
suggests that the shared orientation of this 17-year-old sample Is "law 
and order." The Inference Is derived from a set of questions on which 
there Is fairly high agreement among these respondents and little variance 
among the groups In comparison with a set of questions on which there Is 
relative low agreement and large variation across groups. 

When asked If there should be laws against vandalism and If a crime 
against property would be reported by them, 92.62 and 74.42 of these 17- 
year-olds answered affirmatively. There Is nothing In those responses 
that Is necessarily Improper, of course. Percentages that high simply 
suggest high concern and strong agreement. No group answered either 
questlc-i In a significantly different way. 

In something of a contrast, when asked If they would allow picketing 
against a rock festival and picketing against reported police brutality, 
only 52.62 and 51.62 of these 17-year-olds answered affirmatively. Fur- 
thermore, when analyzed by the four educational categories, there Is con- 
siderable disparity across the groups. The No High School group Is signi- 
ficantly below the National percentages by -19.12 and -13.82| the Some 
High School ^^roup Is significantly below the National percentages by -U.92 
and -l.82| the High School Grad group Is below the National percentages by 
-3.92 and -2.82| and the Post High School group Is significantly above the 
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National percentages by 10. and 4.6S. 

the point 1$ that the 17'-year-olcl8 are very certain and very hono* 
geneoue on the former questions characterized here as having a law and 
order orientation} but they are pusilanimous and disparate on the latter 
questions involving natters of a different order. 

At the Adult levelt this law and order characterization can also 
be supported reasonably well by cooiparing the Adult groups* responses on 
the three questions which are shared by the two age samples. When asked 
the question involving the reporting of a crime against property* 92AI 
of the Adults answered affirmatively, a much higher percentage than for 
17-year-olds. The High School Grad Adult group is significantly above 
the National percentage on the question by 2.1Z. No other group answered 

i 

the question significantly different from the National p^centage. The 
Adults* like the 17-year-old8« are quite certain and fairly homogeneous 
on the question. 

When asked about picketing rock festivals and police stations, 
63*031 and 52. 2Z of the Adults answered affirmatively. They are lOX 
more willing than the 17«year«>old8 in the cne case and about the same 
as the teenagers in the other. When analyzed by educational categories, 
the Adult groups, like the 17-year'^ld8, are markedly different. The No 
High School group is significantly below the National percentages by 
-11. It and -8«lZf the Some High School group is balcu the National per- 
centages by -4.3% and -4.2%; the High School Grad group is above the 
National percentages by 5.9% and 2.3%; and the Post High School group is 
significantly above the National percentages by 15.2% and 12.3%. 
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Beyond this possible orientation, there are other uaeful compari- 
sons to nake among the Adult groups. They are also agreed that race is 
not a proper factor in employment. Adults are verbally accepting of 
racial equality in employment at the 92.3% level. There are no differ- 
ences according to parent^ education. 

At the other extreme, only 55.6% of all Adults would permit an 
fthiest to hold public office, but they vary greatly according to the 
educational environment of their youth homes. Only AU of the Adults 
whose parents never went to high school would allow a non-believer to 
hold office while 76% of those whoss parents went beyond high school 
would do so. 

Ali©, a bare majority of Adults agree that a Constitutional princi- 
ple guidvd the Supreme Court's ruling on religious instruction and 
prayer in public schools. The Post High SchooX group register a res- 
pectable 72.4% on this quest ion| but only 39% of the No High School 
^^^^P w^^h this response. 

Size and Type of Community ^STOC) 

Tables 20 and 21 and Figures 20 and 21 display the median Delta P 
values for the two color schemes. Knowledge of Institutional Structures and 
Knowledge of Institutional Rights and Duties, categorized by Size and Type 
of Coaauttity for the four age samples, 9, 13, 17, and Adult. While all 
seven STOC categories are exhibited, most of the discussions will refer 
only to the High Metro, Unt Metro, Urban Fringe, and Rural groups. The 
justification for this delimitation is in the contrast afforded by these 
8roui)8 and in their characterizations. The High Metro group is mainly 
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affluent, the Low Metro is largely Inner city, the Urban Fringe is sub- 
urban, and the Rural is prlaarily farm. More conplete definitions are 
included as Appendix A. 

Structure g. Table 20 and Figure 20 show the nedian Delta P values 
for these groups and age samples for the Institutional Structures color 
scheme. 

Table 20 

Knowledge of Institutional Structures - STOC 
Social Studies 1971-1972 
Cateftorv o Median Delta P 
c^teftory A ge^ Age 13 A^a 17 

National Red. % 73.8 53.7 72.7 74.4 

I^w Metro .X3.4 -6.7 -8.4 -15.5 

'"'^^^ -3.5 -2.3 -1.8 



Small Place 2.2 



•^'^ -0.5 0.4 



Median City -i.o «o.9 1.2 0.4 

Mam Big City -2.8 -1.9 ^.3 .^.0 



Urban Fringe 1,8 
High Metro 4,5 



2-0 1.8 2.5 

7.2 7.5 



Among the various STOC distributions In the 9-year-old sample, the 
most glaring conclusion Is the gross difference between the Delta P values 
of the High and Low Metro groups. That difference, of course. Is patently 
evident In the display of medians In Table and Figure 20. Actually the 
High Metro group differs loss from the rest of the sample than doeci the 
Low Metro group. The High Metro group Is significantly above the National 
percentages on only two of the five exercises In the theme while the Low 
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DeXta P NINE THIRTEEN SEVENTEEN ADULT 




"•17 «... 

-18 - - • 

-19 - - 

•20 m 

Figure 20 

Knowledge of Institutional Structures 
STOC 
Social Studies 
1971-1972 
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Metro group is significantly below the National percentae«3 on four of 
the five exercises. 

The lowest low Metro despressions of about -162 are on an unreleased 
question about taxes and the question about restaurant inspection. On the 
tax question the National percentage is 83, 2X. The High Metro group is 
a aigaificant 52 above this level. None of the other five groups vary 
significantly on this question. The poorest performance by all 9-year- 
olds is on the restaurant inspection question. Only 362 know that this 
task is a function of health departments i but fewer than one out of five 
of the Low Metro groiip know this fact. That is probably below the 
guessing level. 

About 3/4 of the 9-year-olds know that Judges are responsible for 
fair trials. This knowledge is shared acros« all these STOC groups about 
equally. Only the Urban Fringe groups registers a Delta F value signifi- 
cantly above the National percentage! and that advantage is only 3,62, 
The High Metro group is actually 12 higher} but the statistical controls 
do not label that difference as significant for the High Metros, 

At age 13 there is an apparent slight narrowing of the differences 
between the High Metro group and the Low Metro group as shown in Figure 
20j but a sharper look at the distributions from which these aedians are 
drawn do not bear this out. If anything, the two groups are significan- 
tly different in more areas? but, of course, there are more exercises at 
this age level. The other groups, possibly excepting the Urban Fringe 
and Main Big City groups, are so nearly alike to be indistlngulshablej that 
is, none vary essentially from the National percentages. 

The High and Low Metro groups share three exercises on which neither 



Is significantly different than the National percentages, These also 
happen to be exercises concerning the federal government for which the 
National percentages of success are low, 26,7%, 34.8%, and 47. 2Z. They 
also share four exercises on which they are most varied from each other 
and from the National percent?tjes. The National percentages ara rela- 
tively high in these cases ranging from 67Z to 82. 5Z. Two of the ques- 
tions are about the federal government and two are about local govern- 
ment functions. On two of these four, 81.7: and 87. 4Z of the High Metro 
respondents indicated that the federal government carries nail and local 
governments carry garbage. Only 57.53; and 61. 7Z of the Low Metro stu- 
dents knew these reUtionahips. Main Big City respondents are not much 
betteri 65. 8Z know that garbage collection is moet commonly a local govern- 
ment function. It is on that question that Main Big City respondents are 
most distinguished from other 13-year-olds excepting their neighbors in 
the inner city. Main Big City and Low Metro responses to this question* 
which refers specifically to the likelihood of Increasing garbage collect- 
ions, may be more valid comments on city sanitary departments than on the 
knowledge levels of the respondents. 

At age 17, all STOC groups except High and Low Metro, are clustered 
close to the National percentages of success. Perhaps a dozen Delta P 
values for the middle five groups are large enough to be significant. In 
contrast, all but five Delta P values for the Low Metro groups are signi- 
ficantly below the National percentages and all but two values fcv the 
High Metro groups are significantly above the National percentages. For 
the most part, the two groups respond differently to the questions in this 
color scheme. As groups, they not only differ from each other, but also 
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they differ from all other groups In the sample. 

On two questions, however, these two groups are alike. In fact, with 
the exception of the Main Big City group on one of these questions, the 
entire sample Is homogeneous. On the ballot question which asks If a 
voter can vote for both Kirk and Jones for a single Senate seat, 90X of 
the 17-year-olds said "No." On an unreleased question about school govern- 
ance, about 65Z of all 17-year-olds demonstrate that they know the locus of 
a certain decision. Only the Main Big City group Is a significant 8.4X 
below the National percentage. 

Three other released questions are Illustrative of the difference 
between the High and Low Metro groups. IWo of these have to do with the 
federal government. On a question about raising mall rates, 93,3% of 
the High Metro group correctly Identified this to be a federal government 
funetloni only 78Z of the Low Metro group make this connection. When 
asked how a presidential candidate Is nominated, 60Z of the High Metro 
group said It Is by a national conventloni only 29.73; of the Low Metro 
group know this procedure. At the local level, 95.32 of the High Metro 
group know that local governments commonly collect garbagei but only 76. IZ 
of the Low Metro 17-year-old8 recognize this social task as a local govern- 
ment function. 

As Is observable In Figure 20, the relative positions of the groups 
do not change greatly from the 17-year-old sample to the Adult sample. The 
High Metro group Is high, the Low Metro group is low, and the remaining 
five groups congregate closely about the median Itetlonal percentage of 
success* 

All High Metro Delta P values are above the National percentages from 
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1.5Z r.0 20. 7Z. All but two of these positive values are significant. All 
but two Delta P values of the Urban Fringe group are above the National 
percentages from 0,3Z to 5.5X. The two values below the National percen- 
tages are -0.3% and •0.7Z. About half of the positive values are signifi- 
cant. About half of the Medium City Delta P values are above the National 
percentages from O.AZ to A.7Z and about half are below from -0.3Z to -2.4%. 
None are significant. Over half of the Delta P values of the Small Place 
group are above the National percentages from O.IZ to 3.7Z| the remainder 
are below from O.lZ to 4.6%. Three of those above and two of those below 
are significant. All but two of the Rural group's values are below the 
National percentages from -0.5% to -13.3%i one is at the National percen- 
tage and one is 1.5% above. Five of the negative values are significant. 
About 1/3 of the Delta P values for the Main Big City group are above the 
National percentages from 0.4% to 6.9%i three are significant. The remain- 
ing 2/3 are below from -0.5% to -13.7% with six significantly below. All 
of the Low Metro Delta P values are below the National percentages from 
-1.3% to -28.2%. All but two are significantly below. 

As in the other age samples » a pattern emerges of a central core of 
five groups that behave homogeneously on these exercises. With the excep- 
tion of a half dozen results each for the Main Big City, Rural, and possibly 
the Urban Fringe groups, this core group deviates no more than +-5.0% from 
the National percentages on all exercises. The deviants are the High and 
low Metro groups. With the exception of a half dozen results between them, 
these grotsps deviate no less than ♦-5.0% from the National percentages on 
all exercises. 

The central core groups respond similarly on many exercises i but when 
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the High and tow Metro groups are includeel, the Adults respond alilJke on 
only one exercise. An unreleased question about the armed forces was 
answered correctly by 96.3% of all Adults. No group deviated more than 
♦-1.5Z from the National percentage. The next nearest alike response is 
on the ballot exercise where respondents are asked if they can vote for 
both Kirk and Jones for a state's open Senate seat. No group deviated 
from the National percentage of 90. 2Z more than about 2.02 except for the 
low Metro groi^. It Is a significant -5.3Z below the National percentage. 

On another of the general election ballot questions the difference 
between the High and Low Metro performances Is Illustrated. Among all 
Adults, 70% Interpreted the ballot accurately as enabling them to vote 
for a councilman from each party. More than 80Z of the High Metro respondents 
did HOI but only 46% of the Low Metro group made the correct interpre- 
tation* 

On another exercise, about 60% of all Adults indicated a knowledge 
of national conventions. Nearly 80% of the High Metro group know of the 
procedure? but only about 30% of the Low Metro group said they know 
presidential candidates are nominated in conventions. 

Nearly every exercise, it seems , is a potential example of the 
relative disadvantage of the Low Metro group in this assessment. The 
kinds of explanations one offers for the relatively poor performance of 
this group depend partially at least on his point of view and the set of 
concepts that view entails. One point of view might depend heavily on 
a concept of intelligence; another might utilize broader concepts of 
cognitive abilities; still another would use concepts of culture and 
culture differences. The possible points of view are several and the 
concepts many. 
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One conclusion would necessarily have to be accounted for whatever 
explanation Is hypothesized. Whatever Is measured by these exercises Is 
measured with different results In these polar groups. If some kind of 
ability attends a successful performance on these exercises — • and that 
assumption seems a necessary one — then the High Metro group Is more 
In possession of It than the Low Metro group. What, exactly, that ability 
Is Is less easily described than we might wish. That It Is associated 
with school work seems a likely Inference. That It Is nurtured most 
effectively In an affluent environment seems also legitimately inferred. 
That it is better to have than not to have or that it is related to any- 
thing else worth having are nubbier assumptions. This assessment cannot 
help us with those. 

Rights and Duties, Table 21 and Figure 21 display the median Delta 
P values for the seven STOC categories for the Knowledge of laetitutional 
Rights and JXxtiea in the three age samples, 13, 17, and Adult. There are 
too few exercises to allow the inclusion of the age 9 seaple in these 
exhibits. 

Figure 21 and Table 21 fairly adequately depict the variance aaong 
these groups of 13"Trear-old8 on the ten exercises used to measure Know- 
ledge of Institutior.al Rights and Duties « More specifically, however, 
we have tried to note on which exercises respondents seen to be quite 
similar across the sample and on which exercises they tend to be quite 
different. When we performed this analysis on the Structure questions, 
the High and Low Metro groups appeared dissimilar on most questions in 
all age sample. At the same time, the other five STOC groups appeared 
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quite similar on many questions. In this color scheme, all 13-year-oWs 
are alike relative to one exercise. When asked if there should be laws 
against vandalism, 93.U of all 13-year-olds indicated that there sho^dd 
be. NO group deviated more than 1.42 from this National percentage. None 
of the deviations are significant. 



Table 21 



Knowledge <'UlUi|«i|^,lj§Viili|A"^ '>utle, - STOC 

Medium Delta P 



Age 13 


Age 17 


Adult 


76.6 


80.6 


81.3 


-8.3 


-3.7 


-8.9 


-3.3 


-5.3 


-5.3 


-2.8 


-0.2 


-0.6 


-0.2 


0.8 


-1.1 


1.4 


-1.6 


2.6 


1.4 


2.1 


2.9 


9.4 


5.4 


8.5 



Categories 
National 'Med. X 
Low Metro 
Rural 

Small Place 
Medium City 
Main Big City 
Urban Fringe 
High Metro 



On two other questions, one on due process and the other on free 
assembly, five of the STOC groups are hottogeneous. But U-year-olds in the 
High Metro group are significantly above these others by 7.52 and 10.52 and 
respondents fro« the Small Place group are significantly below their coll- 
eagues by -3.5% and -4.32. 

On three exercises related to religious freedom, the U-year-olds are 
not alike. For example, the 13-year-olds in the High Metro and Main Big 
City groups are more likely to support for office a person who does not 
believe in Cod. Nearly 602 of all U-year-olds would allow such a person 
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10 
9 
8 
7 
6 
5 

3 
2 
1 

•0« 

-1 

-3 
-4 
•5 
-6 

-7 
-8 
-9 

-10 
-U 
-12 
-13 
-U 
-15 
-16 
-17 
-18 
-19 
-20 



AGE. , 
NINE 



THIRTEEN 



SEVENTEEN 



ADULT 



HIGH METRO 




-URBAN FRINGE 
MAIN BIG cm 



- NATIONAL 
SMALL PLACE 

MEDIUM CITY 



RURAL 



iLOW METRO 



Figure 21 

Knowledge of Institutional Rights and Duties 

STOC 
Social Studies 
1971-1972 
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to hold office; 752 of the High Metro group and about 632 of the Main Big 
City youths are of this mind. At the same tim, only 55% of the 13-year- 
olds fr«a Small Places and 46% of the Low Metro youths suppwt this belief. 
On the other two unreleased religious freedom questions, the variations 
are different, though the High Metro group registers consistently higher 
percentages than any other group. The Rural, Low Metro, and Small PUce 
groups are significantly below the National percentages on one or the other 
of the exercises. 

Four of the STOC groups. Medium City, Urban Fringe, Main Big City, 
and Low Metro, show no significant variance from the National percentage 
of 88. 8X on the question of racial discrimination In employment. The other 
three groups, 'however, vary significantly on this question — Small Place 
residents by -3.22, Rural by -4.1Z, and High Metro by 7.4%. 

Fewer than half of all 13-year-old8 believe in or recognize the free- 
dom of the press in politically sensitive areas. Both Rural and Low Metro 
groups are even below this level at 36% and 39.3%. The High Metro group 
is significantly above the National percentage and all other groups at 
61.5%. Freedom of the press gets short shrift among 13-year-olds, as do 
several other basic democratic rights and freedoms. 

By 17 years of age an overall gain of 4% Is noted relative to the 13- 
year-old median National percentage, as shown in Table 21. To the extent 
that the two sets of exercises are comparable, the gain may be Interpreted 
as an Increase in the understanding of our institutional rights and duties 
or possibly an increase In commitment to them. But also, as can most 
easily be seen In Figure 21, there are some shifts in the relative position 
of some groups. The most notable of these, according to an analysis of 
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exercises, is the exchange of Rural and Uw Metro groups in the position 
Of exhibiting the lowest median Delta P score. The Main Big city and 
High Metro groups also shift downward. However, because the Main Big 
Citys median Delta P value stays clustered with those closest to National 
percentages, its change in status does not make so much difference on most 
exercises. Also, since the High Metro group retains its highest position 
relative to a National percentage, its distribution is not much different. 

Within the 17-year-old sample, the High and Low Metro and Rural groups 
are most deviant. We will emphasize these groups in the discission and re- 
fer incidentally to the other groups which tend to be fairly homogeneous. 

In an earlier section we referred to a set of two questions as seem- 
ing to have a law and order orientation. It included the often cited ex- 
ercise on vandal laws and an unreleased question on crime reporting. In 
this age sample. Rural youths record their highest Delta P values on these 
exercises. The Small Place group almost equals the Rural youths* special 
concern for these matters. At the opposite end, the High Metro group 
places these two questions In low priority. It achieves significant nega- 
tive Delta P values on both. That In Itself is notable, for the High Metro 
group has very few Delta P values below the National percentages. 

More characteristically, the High Matro group has positive Delta P 
values ranging frc« UX to nearly UX on a set of five exercises that seem 
to measure preferences for open protest, freedom of the press, and free- 
dom of religion. We suggested earlier that these questions have a liberal 
orientation. The 17-year-olds as a total group are not overly fond (or 
apprised) of these Ideas; but Rural and Small PUce youths find them espec- 
ially distasteful (or unfamiliar). About 45X of the Small Place group and 
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35% of the Rural group, for example, would permit a police station to be 
picketed. On this exercise the Low Metro achieves its highest Delta P 
value; 57,8% of that group would allow such a protest. Low Metro youths 
do not tend to extend this right to include picketing of rock festivals, 
howeveri only 46.22 would allow that action. The High Metro group does 
not differentiate between these objects? nearly 2/3 would allow both a 
police station and a rock festival to be picketed. 

The hardest question for 17-year-olds tested their knowledge of the 
Supreme Court's decision on religion In schools. Only half marked It as 
relating to the principle of church and state separation. The Urban 
Rrlnge group did best of all groups on that questloni nearly 60% could 
answer It correctly. That amounts to a 201 advantage over the Low Metro 
group which did the poorest of all groups on the question. 

The easiest question for 17-year-old8 relates to race as a factor 
In ea^Hoyment. It Is also on<i of the few questions on which the 17-year- 
olds are much alike, accept for the Main Big city group, which produced 
a Delta P value of -4.32, all groups are within 2% of the National per- 
centage of 93. 8Z. 

At the Adult level, the most Interesting coioparlsons are again among 
the High and Low Metro and Rural groups. The Interest derives from their 
extreme variance on a number of exercises. Those variances are reflected 
la the median values reported In Table 21 and Figure 21. The four central 
groups. Urban Ftlnge, Main Big city, Small Place, and Medium City, vary 
from the National percentages on Individual exercises no more than 4-8. 2X. 
In contrast, the Rural Adults have a dispersion of 25.52 running from 
3.82 to -21.72) the Um Metro group goes from 6.42 to -20.82 for a dls- 
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persion of 27.2Xf and the High Metro group has a low Delta P value of 
O.OX and a high value of 25. 2J:. 

Nine of twenty exercises in this color scheme have been released. 
As a means of illustrating the wide variances among these three groups, 
six of these nine exercises are listed below in Table 22 along with 
their National percentages of success and the Delta P values for the 
High and Low Metro and Rural groups. An •*. beside a Delu P value indi- 
cates that the difference from the National percentage is large enough 
to be statistically significant. 

The point of the display in Table 22 is to illustrate that the Adults 
in these three STOC groups are indeed different in the way they perform 
on the Rights and Duties exercises. The groups also appear to vaiy froB 
each other on the remaining 14 exercises in the color scheme. The Rural 



Table 22 

Comparison of High and Low Metro and Rural Adults 
9n Selected Rights and Duties Exercises 
Social Studies 1971-1972# Delta P 



Short Text of Exercise 



Allow picketing of police station 

Supreme Court decision on religi- 
on in schools 

Allow athiest to hold public 
office 

Allow picketing of rock festival 
Assemble in park for protest 
Race a factor in employment 



National Rural 
Percentage ^Ita P 



52.2 

52.3 

55.6 
63.0 
77.5 
92.3 



-21.7* 

-8.8* 

-U.4* 
-10.6* 
-13. 8* 
-6.3* 



High 
Metro 
Delta P 



16.5* 
17.4* 

25.2* 
15.1* 
10.3* 
0.2 



Low 
Metro 
Delta P 



6.4* 

-18.3* 

-3.8 
-20.8* 
-9,8* 
2.3 
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and iow Metro groups cone closest together on the question concerning 
the right to assemble. Only 4 percentage points separate the results. On 
three exercises, they are separated by about 10 percentage points i and on 
one, they are 28,1 percentage points apart. The three groups are nost 
nearly alike in their responses on the question about racial discrimination. 
On that question, the High and Low Metro groups are alike. I.e., their 

« 

deviations from the National percentage are not significant. 

The High Metro and Rural groups are nost different In their responses 
to the question on picketing police. Over 2/3 of the High Metro Adults 
would allow that} only 1/3 of the Rural Adults would. The High and Um 
Metro grwips are aost different In their responses to picketing rock festi- 
vals. Where 78.1% of the High Metro Adults would support such an activity, 
only 42.22 of the Low Metro Adults would. 

An l«pllcatlon of these differences Is that more than a single factor 
affected the responses of the three groups. Picketing as an activity seems 
relatively equally acceptable to High Metro Adults In very different con- 
texts. It seems fairly unacceptable to Rural Adults In either circumstance, 
but more so In one than In the other. It seems more acceptable to Low Metro 
Adults when directed against police than when directed against rock festi- 
vals. A social comment with several facets seems burled In those results. 
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We atteapted as an overall strategy to divide a selected set of A8 
exercises from NAEP's Assessment in Social Studies of 1971-1972 Into two 
parts. One part is conprised of items which we judged to deal mainly 
with variou sitructural elements of institutiofss. The other part is con- 
prised of items which we Judged to deal primarily with rights and duties 
within these institutions. Though we persist in using the broader term 
of "institutiosk?," most of the exercises, as it turns out» relate most 
directly to the institution of government. Some of the same exercises 
were used as the basis of the NAEP publication. Political Knowledge and 
Attitudes 1971-1972> written by Professor Gerald L. Marrlner and Robert 
Orane» 

In rentrospect, the division of exen^cises into Structure and Rights 
and Duties color schemes appears to have had only a visual warrant since 
the two sets <i>f quest'Aons produced very similar statistical discriminations 
among the various categories of persons assessed. That makes one believe \ 
that similar factors operated in the two parts $ the two color schemes, in 
effect, appear to have assessed the same thing, whatever that is. We could 
centlaue to insist obdurately — which we do — that the subject matter 
division is valid, visually if not otherwise, and that the samples of per- 
sons assessed are in roughly equal possession of the two contents. 

The parallel results along with either of these explanations can be 
thought of an partial justification for another decision made about the 
content of the two color schemes. Both sets of questions were approached 
as if they measured knowledge. That decision will not bear up under a visual 
inspection of exercises, however, because some questions, especially In the 
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Rights and Duties color scheme^ contain the value term "should" as the 
interrogative. Our a. Priori Justlf ieutlon for largely ignoring this ele- 
mentary distinction in these questions is argued elsewhere. Mainly^ that 
justification suggests that the involved questions refer to fully insti- 
tutionalized rights in this society and do not, in a real sense* pose 
issues. These questions* the argument continues* may just as validly be 
assessing these persons* knowledge of these rights as their preferences 
for them. While Marriner and Crane treat some of these questions as 
outright value questions* as do we guardedly in several of our discussions, 
the parallel results of the two scheme analysis used in this report seem 
to add some measure of justification to ignoring the distinction for this 
assessment. 

An assumption was invoked on occasion in this analysis that results 
across age samples imply growth or change. The use of line graphs to 
depict the median performances of the categories of persons at different 
age levels appears to endorse this assumption. Thet truth of the matter is 
that we do not know for certain whether the performance of any age group 
in this assessment can be projected either forward or backward on the 
basis of the performance of any other age group* even though they may 
share several questions. Therefore* all statements which suggert or state 
outright that the l7-year-old8 learned something of this content between 
the ages of 13 and 17 or that the Adults have not learned much of this in- 
formation since their school days must be read more cautiously than they 
were written. We found it useful to hypothesise these projections i but 
more and different information than is available froa: this assessment would 
be needed to say such things reliably. 
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Evan with all the analysas, categories » color schenet* and age aamplee 
It is still most difficult to account for any of the results In the assess** 
ment. The reasons for this interpretive Inpasse are so well known by 
thoughtful school people that it seems gratuitous to mention then. Inter- 
pretive li&passe notwltlwtandlng, occasionally we did cast what could pass 
for an explanatory hypothesis i alblet, at some later date we aay need to 
seek forgiveness for sone of the«. What we have here Is a siass of descri- 
ptive datat confounded In all the ways that such data are always confounded 
In spite of NAEP's metlculoslty, and In which exists not one explanation. 

A few content generalizations appear to emerge with so«e consistency 
In the themes reported In this analysis. One that ccnes to mind Is the re- 
current emphasis on law and order and the protection of property. What- 
ever the reasons for the high acceptance of these values » their eBQ>hasls In 
this assessment by many groups suggests something other than a general 
breakdown In the concern for security In this society. Another emphasis 
that seems clear Is the high agreement by most groups that race should not 
be a factor In employment. That would seem to represent a major change In 
the social preferences in this country over the past decade or so. 

We» of course* can state several facts with some firmness about the 
categories of persons assessed. We can say that persons of all ages* I.e., 
ages 9, 13» 17, and Adult, whose parents went to college, persons of all 
ages who live In relative affluence, persons who live In the northeast part 
of our country, males at age 17 and as adults, and whites at all ages are 
the most able of all categories of persons sampled to respond according to 
the criteria of this assessment. 

We can also say, given the content, definitions, and criteria of this 
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asseasaent* that persons whose parents never went beyond the eighth grade* 
persons who live in the inner city» persons who live in the southeast part 
01. this country 9 females « and Blacks do not score as well on these exer*- 
cises as do persons in most other categories. The data tell these facts; 
hut they don*t answer the important questions* 

The ia^ortant questions fall in two categories. In the first of 
these* the questions stab angrily into the inner mechanisms and justifi- 
cations of NAEP. Other researchers in this social studies project have 
raised some of these important questions. Others have been raised in 
different forums. This report has perhaps raised fewer than it should. 
Oni stands out as signally important at the moMent. Is it possible to 
construct an assessment that examines validly^ reliably* and fairly a 
plural population? There seems obviously a sense in which pluralism should 
dictate the standards that are applied in such a mass accounting of our 
schools and ourselves. Our differences and diversity surface in this Social 
Studies Assessment as they do in all such assessments. But we seem easily 
tempted to judge the reasonable responses of others who enjoy different ad- 
vantages than our own as less reasonable than our own. 

In another category* the important questions seem mostly to test our 
social understandings and motivations. Why do these groups of persons be- 
have differently on this assessment? The assessment's yield of descriptive 
data won't suffice to account for the differences. Do we want — more 
importantly* should we want — such groups to perform more evenly? If we 
do* how can schools help to make it happen? 

The two categories of questions turn rapidly into each other. While 
we assume that some of the diversity exhibited in the assessment is a 
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function ot the assessaent and sme a function of schooling* beyond these* 
much of it is undoubtedly a product of this society. If for some reasons 
we desire a population that performs more evenly in such assessments* alt- 
erations that go beyond the unbiassing of a test and that go beyond the 
equalizing of schooling are likely to be necessary. Given the apparent 
value conflicts in this society and the different frames of reference 
which are displayed by this population* such a desire would seen empty* even 
if it were justifiable. 
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APPENDIX A 



Definltloos of Size and lype of Coronunltr Categories (STOC) 
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Definitio ns of Size and Type of Coaamunlty Catefcorles (STOC) 

There are seven size and 2ype of eownunlty (STOC) categories. The 
STOC categories apply only to the respondents enrolled in school at the 
tl»e of the assessment. These are defined briefly here. 



Low Metro. This category comprises 7.25Z of the total sanple and 
represents individuals attending schools whose students have the largest 
proportions of parents not regularly employed and/or on welfare. 



fiXtywe Rttgftl,* This category comprises 9,l5X of the total sample 
and represents Individuals attending schools whose students have the 
largest proportions of parents engaged In farm work. 



Small Place. This category cotaprlses 28.29Z of the total sample 
and represents Individuals attending schools In connunltles with popula- 
tions less than 25*000 and not classified under Extreme Rural. 



Medium Cltv. This category represents 17.40Z of the total sample 
and represents individuals attending schools In eoanunltles with popula- 
tions between 25*000 and 200*000 and not classified In how Metro. Extreme 
Rural* or High Metro. 



Main BU Cltv. This category comprises 8.41Z of the total sample 
and represents Individuals attending schools within the city limits of 
cities with popuUtlons greater than 200*000 and not classified In Low 
Metro or High Metro. 



yi^ban Frlnf^e. This category comprises 17.353! of the total sample and 
represents individuals attending schools in metropolitan areas served by 
cities with populations greater than 200*000 but outside the city limits 
and not classified in Low Metro* &etreme Rural* or High Metro. 



Hi^h Metro. This category comprises 12.15Z of the total sample and 
represents Individuals attending schools whose students have the largest 
proportions of parents in professional or managerial positions. 



4 f 
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APPENDIX .B 



X« Identification by Color Schenss of NAE? Social Studies 
IttM Used in the NCSS Analysis ' 

2. Display of NAEP Social Studies Items Included in the 
NCSS Analysis 
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1* Kl^ncif Icatlon by Color Schemes of NA£P 
Social Studies Items Used in the KCSS Analysis 



Items Judged to Assess 
Knowledge of Institutional 
Structures 



402008 
403005 
403017 
403021 
405035 
406010 
406011 
406012 
406015 
A 406017' 
B 406017" 
C 406017' 
406017- 
406017' 
406018- 
406019' 
406020' 
406021- 
406022- 
A 406033- 
B 406033- 
C 406033" 
D 406033' 
B 406035* 
C 406035- 
D 406035 



0 
E 



-1*R 
-234 U 
-1 U 
■1 U 
•234 U 
•1 R 
■234 R 
•234 R 
•234 U 
•34 R 
•34 R 
•34 R 
•34 R 
•34 R 
•234 U 
•234 R 
•234 U 
•234 U 
•1 R 
'234 U 
'234 U 
234 U 
234 U 
234 
234 



R 
R 



-234 R 



Items Judged to Assess 



Knowledge of Institutional 


Rights 


and Duties 




406005-34 R 




406009-1234 U 




406023-2 U 




501010-34 U 


A 


501011-34 R 


B 


501011-34 R 


A 


502002-34 R 


B 


502002-34 R 


A 


502007-234 R 




502008-34 U 


A 


502009-234 U 


A 


502010-234 R 




502011-234 U 




502012-234 R 


A 


502013-34 U 


A 
CI 


502016-34 R 


c 


502016-34 R 


A 


502017-34 U 


C 


503010-23 R 


A 


503012-2j?4 U 


A 


503015-34 U 


A 


527006-234 R 



** R - Released * 1 . item for age 9. 

U • Unreleased 2 - item for age 13 

3 item for age 17 

4 ■ item for Adult 
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2, Display of Na£P SoeUl Studies 
Items Included ia che NCSS* Analysis 

Items Judge d to Assess Knowledge of Institutional Structures 
402008-1 ■ 

Below are listed four of the many jobs that are done in a city. 
Which one of the jobs is done by the health department? 

Selling food 
Directing traffic 
Putting out fires 
Inspecting restaurants 
I don*t know. 



403005-234 

Unreleased item on taxation, 
403017-1 

, Unreleased item on taxation. 

403021-1 

Unrelea&ed item on a consumer topic. 
405035-234 

Unreleased item on the United Ifetions, 
406010-1 

In a court, which one of the following has the job of making sure 
that the trial is fair and run according to the rules? 

The judge 
The lawyer 
The jury 

The person on trial 
I don't know. 



406011-234 

In the United States which one of the following men is elected to 



A United States Senator 

The United Stites Secretary of State 

A United States Supreme Court Justice 

The united States Ambassador to Great Britain 

I don't know. 



406012-234 



The presidential candidate for each 'major political, party is form- 
ally nominated by which one of the following? 

The Senate 

A national primary 

A national convention 

The House of Representatives 

I don* t know. 
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A0601 5-234 

Unreleased item on the federal government. 
A A06017-34 

The ballot below was used in a general election. Look at the ballot 
to answer the ques tions on this and the fol lowing two pages. 
LEGISLATIVE 



OFFICES 



D£MOCRATIC 



REPUBLICAN 



SENATOR 
IN CONGRESS 



jy ote for o ne) 



j REPRESENTATIVE 
IN CONGRESS 



Alan F. 
KIRK 



James M. 
JONES 



(vote for one) 



John G. 
SMITH 



Mary 
O'CONNOR 



COUNTY 

COUNCILMAN 
(votefor two) 



Martha G. 
DAVIS 



John 
RICHARDS 



Peter V. 
MOSS 



Michael M. 
MERWIN 



TAX ASSESSOR 
(vote for one) 



Joseph L. 
LASKI 



If you wanted to vote for Kirk for senator, could you also vote for 
O'Connor for member of the House of Representatives? 

Yes 
No 

I don't know. 
B A06017-34 

Could you vote for both Davis and Moss for councilman? 

Yes 
No 

I don't know. 
C A06017~34 

Could you vote for both Davis and Merwin for councilman? 
Yes 
No 

I don't know, 
D 406017-34 

''T 5?si^'«^«^ ^® ^ '"e'^ber of the Democratic Party, could you 
vote for laski for tax assessor? 

Yes 
No 

I don't know, 
E 40601 7«23 

Could you vote for both Kirk and Jones for senator? 
Yes 
No 

I don't know. 



ERIC 
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A06018-234 

Unreleased item on the federal legislative branch. 
A06019-23A 

Which one of the following has the power to declare an act of 
Congress unconstitutional? 

The Congress 
The President 

The United States Supreme Court 

The United States Department of Justice 

I don't know. 

406020- 234 

Unreleased item on the federal executive branch. 

406021- 23A 

Unreleased item on the federal executive branch. 

406022- 1 

The head of government in the United States is the President, 
f ioSn?"^ following is usually the head of government in 

The major 

The governor 

The chief of police 

The school principal ^ - 

I don't know. 

A 406033-234 

Unreleased item on government. 
B 406033-234 

Unreleased item on government. 

C 406033-234 

Unreleased item on government. 
D 406033-234 

Unreleased item on government. 
B 406035-234 

^i^'ttlt 5?Ucwine would MOST likely pass an act to raise 

the rates for sending letters through the mail? 

Federal government 
State government 
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Local government 
I don't know. 



C 406035-234 



Which one of the following would MOST likely pass an act to lower 
taxes on goods coining into the country? 



Federal government 
State government 
Iccal government 
I don*t know. 



D 406035-234 



^rSlfL?i 'II- ^^^^^"f"S would MOST likely pass an act to increase 
garbage collection services? 



Federal government 
State government 
X/>cal government 
I don*t know. 



Items Judged to Assess Knowledf^e of Institutional Rights and Duttag 



406005-34 

The Supreme Court ruled that it is unconstitutional to reouire 
prayer and formal religious instruction in public schools. 

Which one of the following was the basis for its decision? 

The requirements violated the right to freedom of speech. 
There was strong pressure put on the Supreme Court by certain 
religious minorities. v^i-t-axH 

Religious exercises violated the principles of the separation 
of church and state. 

Every moment of the valuable school time was needed to prepare 

students to earn a living. 
I don*t know, 

406009-1234 

Unreleased item on the United Nations. 
406023-2 

Unreleased item on a Constitutional right. 
501010-34 

Unreleased item on due process. 
A 501011-34 

Should a congressman pay attention to the opinions and concerns of 



-127- 



people whose views are different from those of the mjority? 

Yes 
No 

Undecided 

B 5010X1-34 

Please explain any answer you selected, 

A 502002-34 

Indicate whether you agree or disagree with the following statement j 

Anyone who criticizes the use of United States troops in military 
action abroad should be prohibited from expressing his views publicly. 

Agree 
Disagree 

B 502002-34 

Please explain your position, 

A 502007-234 

In the picture, there are many people gathered together in a public 
park. They are demanding changes which you do not agree with. Should 
these people be allowed to gather and make their demands in a public 
place? 

Yes 
No 

Undecided 
No response 

502008-34 

Unreleased item on a Constitutional right. 
A 502009-234 

Unreleased item on a Constitutional right, 
A 502010-234 

Should a newspaper or magazine be allowed to publish something that 
criticizes an elected government official? 

Yes 
No 

Undecided 

502011- 234 

Unreleased item on freedom of speech. 

502012- 234 

Should a person who does not believe in God be allowed to hold a 
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public offica? 

Yes 
No 

Undecided 

A 502013-34 

Unreleased item on freedom of the press, 

502016-34 



'^''"^^ ^^^^^^^ t<> Picl^et the holding of a 
rock festival as a protest against it? 



Yes 
No 

Undecided 
No response 



C 502016-34 

^o^est'^i^rKn^^nifll'^i^ be allowed to picket a police station 
protest reported police brutality? 

Yes 
No 

Undecided 
No response 

A ri02017-34 

Unreleased item on freedom of speech. 

C 503010-23 

Yes 
No 

Uhdecided 

A 503012-234 

Unreleased item on due process. 

A 503015-34 

Unreleased item on law and order, 

A 527006-234 

Should race be a factor in hiring someone for a job? 

Yes 
No 

I don't know. 



